Visualizing Supervised Machine Learning

Credit

Inspirations by Leonard Thiele, Antonio Sánchez Friedeberg, and Sean Pedersen
Parts of the code based on material from scikit learn documentation

Please send questions and feedback to oliver.zeigermann@gmail.com or @DJCordhose on Twitter, I will be happy to explain or add to this notebook



In [1]:

    
import warnings
warnings.filterwarnings('ignore')



In [2]:

    
%matplotlib inline
%pylab inline









    



Populating the interactive namespace from numpy and matplotlib



In [3]:

    
import matplotlib.pyplot as plt
plt.xkcd()









    Out[3]:





<contextlib._GeneratorContextManager at 0x1f26aa83908>



In [4]:

    
# if this is true, all images are saved to disk
global_print_flag = False



In [5]:

    
!mkdir tmp_figures









    



A subdirectory or file tmp_figures already exists.

Loading and exploring our data set

This is a database of customers of an insurance company. Each data point is one customer. The group represents the number of accidents the customer has been involved with in the past

0 - red: many accidents
1 - green: few or no accidents
2 - yellow: in the middle



In [6]:

    
# Choose one of the two following data sets, the larger one gives better results, but might clutter the visualization depending on resolution

# !curl -O https://raw.githubusercontent.com/DJCordhose/ai/master/notebooks/scipy/data/insurance-customers-1500.csv
# !curl -O https://raw.githubusercontent.com/DJCordhose/ai/master/notebooks/scipy/data/insurance-customers-300.csv



In [7]:

    
import pandas as pd
# df = pd.read_csv('./insurance-customers-300.csv', sep=';')
df = pd.read_csv('./insurance-customers-1500.csv', sep=';')



In [8]:

    
df.head()









    Out[8]:







  
    
      
      max speed
      age
      thousand km per year
      group
    
  
  
    
      0
      148.0
      44.0
      25.0
      1
    
    
      1
      168.0
      54.0
      24.0
      1
    
    
      2
      161.0
      26.0
      34.0
      0
    
    
      3
      137.0
      25.0
      10.0
      2
    
    
      4
      164.0
      38.0
      22.0
      1



In [9]:

    
df.describe()









    Out[9]:







  
    
      
      max speed
      age
      thousand km per year
      group
    
  
  
    
      count
      1500.000000
      1500.000000
      1500.000000
      1500.000000
    
    
      mean
      171.386000
      44.969333
      30.511333
      0.998667
    
    
      std
      19.269126
      16.935040
      15.112317
      0.816768
    
    
      min
      118.000000
      18.000000
      5.000000
      0.000000
    
    
      25%
      158.000000
      32.000000
      18.000000
      0.000000
    
    
      50%
      170.000000
      42.000000
      29.000000
      1.000000
    
    
      75%
      187.000000
      55.000000
      42.000000
      2.000000
    
    
      max
      216.000000
      90.000000
      84.000000
      2.000000

A pairplot gives you a nice overview of your data with just a few lines of code



In [10]:

    
import seaborn as sns
sns.set(style="ticks")

sample_df = df.sample(n=120, random_state=42)

colors_light = {0: '#FFAAAA', 1: '#AAFFAA', 2: '#FFFFDD'}
colors_bold = {0: '#AA4444', 1: '#006000', 2: '#EEEE44'}

sns.pairplot(sample_df, hue="group", palette=colors_bold)









    Out[10]:





<seaborn.axisgrid.PairGrid at 0x1f26c5e42e8>

Concepts

First important concept: You train a machine with your data to make it learn the relationship between some input data and a certain label - this is called supervised learning



In [11]:

    
# we deliberately decide this is going to be our label, it is often called lower case y
y=df['group']



In [12]:

    
# since 'group' is now the label we want to predict, we need to remove it from the training data 
df.drop('group', axis='columns', inplace=True)



In [13]:

    
# input data often is named upper case X, the upper case indicates, that each row is a vector
X = df.as_matrix()

We restrict ourselves to two dimensions for now

Because this is all we really can visualize in 2d



In [14]:

    
# ignore this, it is just technical code to plot decision boundaries
# Adapted from:
# http://scikit-learn.org/stable/auto_examples/neighbors/plot_classification.html
# http://jponttuset.cat/xkcd-deep-learning/

from matplotlib.colors import ListedColormap

cmap_print = ListedColormap(['#AA8888', '#004000', '#FFFFDD'])
cmap_bold = ListedColormap(['#AA4444', '#006000', '#EEEE44'])
cmap_light = ListedColormap(['#FFAAAA', '#AAFFAA', '#FFFFDD'])
font_size=25
title_font_size=40

def meshGrid(x_data, y_data):
    h = 1  # step size in the mesh
    x_min, x_max = x_data.min() - 1, x_data.max() + 1
    y_min, y_max = y_data.min() - 1, y_data.max() + 1
    xx, yy = np.meshgrid(np.arange(x_min, x_max, h),
                         np.arange(y_min, y_max, h))
    return (xx,yy)
    
def plotPrediction(clf, x_data, y_data, x_label, y_label, ground_truth, title="", 
                   mesh=True, fname=None, print=False):
    xx,yy = meshGrid(x_data, y_data)
    fig, ax = plt.subplots(figsize=(20,10))

    if clf and mesh:
        Z = clf.predict(np.c_[yy.ravel(), xx.ravel()])
        # Put the result into a color plot
        Z = Z.reshape(xx.shape)
        ax.pcolormesh(xx, yy, Z, cmap=cmap_light)
    
    ax.set_xlim(xx.min(), xx.max())
    ax.set_ylim(yy.min(), yy.max())
    if print:
        ax.scatter(x_data, y_data, c=ground_truth, cmap=cmap_print, s=200, marker='o', edgecolors='k')
    else:
        ax.scatter(x_data, y_data, c=ground_truth, cmap=cmap_bold, s=100, marker='o', edgecolors='k')
        
    ax.set_xlabel(x_label, fontsize=font_size)
    ax.set_ylabel(y_label, fontsize=font_size)
    ax.set_title(title, fontsize=title_font_size)
    if fname and global_print_flag:
        fig.savefig('tmp_figures/'+fname)
        
def plot_keras_prediction(clf, x_data, y_data, x_label, y_label, ground_truth, title="", 
                          mesh=True, fixed=None, fname=None, print=False):
    xx,yy = meshGrid(x_data, y_data)
    fig, ax = plt.subplots(figsize=(20,10))

    if clf and mesh:
        grid_X = np.array(np.c_[yy.ravel(), xx.ravel()])
        if fixed:
            fill_values = np.full((len(grid_X), 1), fixed)
            grid_X = np.append(grid_X, fill_values, axis=1)
        Z = clf.predict(grid_X)
        Z = np.argmax(Z, axis=1)
        Z = Z.reshape(xx.shape)
        ax.pcolormesh(xx, yy, Z, cmap=cmap_light)
        
    ax.set_xlim(xx.min(), xx.max())
    ax.set_ylim(yy.min(), yy.max())
    if print:
        ax.scatter(x_data, y_data, c=ground_truth, cmap=cmap_print, s=200, marker='o', edgecolors='k')
    else:
        ax.scatter(x_data, y_data, c=ground_truth, cmap=cmap_bold, s=100, marker='o', edgecolors='k')
        
    ax.set_xlabel(x_label, fontsize=font_size)
    ax.set_ylabel(y_label, fontsize=font_size)
    ax.set_title(title, fontsize=title_font_size)
    if fname and global_print_flag:
        fig.savefig('tmp_figures/'+fname)



In [15]:

    
X_kmh_age = X[:, :2] 
plotPrediction(None, X_kmh_age[:, 1], X_kmh_age[:, 0], 
               'Age', 'Max Speed', y, mesh=False,
                title="All Data",
                fname='all.png')

We provide a few hand built classifiers as base lines

a base line can be a very simple classifier that shows what is doable with limited effort
a more sophisticated approach needs to do better than a base line, otherwise it has no point
how well a classifier does is described as a score for accuracy



In [16]:

    
# 0: red
# 1: green
# 2: yellow

class ClassifierBase:
    def predict(self, X):
        return np.array([ self.predict_single(x) for x in X])
    def score(self, X, y):
        n = len(y)
        correct = 0
        predictions = self.predict(X)
        for prediction, ground_truth in zip(predictions, y):
            if prediction == ground_truth:
                correct = correct + 1
        return correct / n

from random import randrange

class RandomClassifier(ClassifierBase):
    def predict_single(self, x):
        return randrange(3)



In [17]:

    
random_clf = RandomClassifier()



In [18]:

    
plotPrediction(random_clf, X[:, 1], X[:, 0], 
               'Age', 'Max Speed', y,
                title="Random Classifier",
                fname='random.png')



In [19]:

    
# this computes how many values are predicted correctly, this should be 0.33 (33%) on average, but will differ with each run

random_clf.score(X, y)









    Out[19]:





0.348



In [20]:

    
# just a few rules created by hand

class BaseLineClassifier(ClassifierBase):
    def predict_single(self, x):
        try:
            speed, age, km_per_year = x
        except:
            speed, age = x
            km_per_year = 0
        if age < 25:
            if speed > 180:
                return 0
            else:
                return 2
        if age > 75:
            return 0
        if km_per_year > 50:
            return 0
        if km_per_year > 35:
            return 2
        return 1



In [21]:

    
base_clf = BaseLineClassifier()



In [22]:

    
plotPrediction(base_clf, X[:, 1], X[:, 0], 
               'Age', 'Max Speed', y,
                title="Manual Classifier",
                fname='prog.png')

The lines between the areas of prection are called decision boundaries



In [23]:

    
base_clf.score(X, y)









    Out[23]:





0.454

Second important concept: To have an idea how well the training worked, we save same data to test our model on previously unseen data.

The real objective is to have a generalized model that works well on the test data.
How well it performs on this test data as opposed to the training data tells us quite a bit as well.
Typical splits are 60% for training and 40% for testing or 80/20
It is important that we do not use the test data to tweak the hyper parameters of our learning strategy - in this case the test data would (indirectly) influence the training and can no longer tell how well we did
evaluate the test date set only once at the end of your experiment



In [24]:

    
from sklearn.model_selection import train_test_split



In [25]:

    
# using stratefy we get a balanced number of samples per category (important!)

X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.4, random_state=42, stratify=y)



In [26]:

    
X_train.shape, y_train.shape, X_test.shape, y_test.shape









    Out[26]:





((900, 3), (900,), (600, 3), (600,))



In [27]:

    
np.unique(y_train, return_counts=True)









    Out[27]:





(array([0, 1, 2], dtype=int64), array([301, 300, 299], dtype=int64))



In [28]:

    
np.unique(y_test, return_counts=True)









    Out[28]:





(array([0, 1, 2], dtype=int64), array([200, 200, 200], dtype=int64))



In [29]:

    
X_train_2_dim = X_train[:, :2]
X_test_2_dim = X_test[:, :2]



In [30]:

    
plotPrediction(None, X_train_2_dim[:, 1], X_train_2_dim[:, 0], 
               'Age', 'Max Speed', y_train, mesh=False,
                title="Train Data",
                fname='train.png')



In [31]:

    
plotPrediction(None, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test, mesh=False,
                title="Test Data",
                fname='test.png')

KNN - Most basic learning strategy: Look at the neighbors to make a prediction for a sample yet unknown



In [32]:

    
from sklearn.neighbors import KNeighborsClassifier
clf = KNeighborsClassifier(1)



In [33]:

    
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 2 ms






    Out[33]:





KNeighborsClassifier(algorithm='auto', leaf_size=30, metric='minkowski',
           metric_params=None, n_jobs=1, n_neighbors=1, p=2,
           weights='uniform')



In [34]:

    
plotPrediction(clf, X_train_2_dim[:, 1], X_train_2_dim[:, 0], 
               'Age', 'Max Speed', y_train,
                title="Train Data, KNN, k=1",
                fname='knn1-train.png')



In [35]:

    
clf.score(X_train_2_dim, y_train)









    Out[35]:





0.9633333333333334



In [36]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, KNN, k=1",
                fname='knn1-test.png')



In [37]:

    
clf.score(X_test_2_dim, y_test)









    Out[37]:





0.6366666666666667



In [38]:

    
# http://scikit-learn.org/stable/modules/cross_validation.html
from sklearn.model_selection import cross_val_score



In [39]:

    
# cross_val_score?

Cross Validation splits the train data in different ways and performs a number of training runs (3 in this case)



In [40]:

    
scores = cross_val_score(clf, X_train_2_dim, y_train, n_jobs=-1)
scores









    Out[40]:





array([0.61129568, 0.66666667, 0.65217391])



In [41]:

    
print("Accuracy: %0.2f (+/- %0.2f)" % (scores.mean(), scores.std() * 2))









    



Accuracy: 0.64 (+/- 0.05)

Third important concept: Our objective is to make the best prediction for unknown samples. This is called generalization. If we perform well on knwon data, but less good on unknown data this is called overfitting. This is to be avoided. Measures taken to avoid overfitting are also known as regularization.

In KNN we reduce overfitting by taking more neighbors into account

We can try what is the best number of numbers manually, but grid search does the same thing, only with less manual effort. This one tries the number of neighbors between 1 and 50



In [42]:

    
from sklearn.model_selection import GridSearchCV
param_grid = {
    'n_neighbors': list(range(1, 50)),
    'weights': ['uniform', 'distance']
    }
clf = GridSearchCV(KNeighborsClassifier(), param_grid, n_jobs=-1)
%time clf.fit(X_train_2_dim, y_train)
clf.best_params_









    



Wall time: 8.09 s






    Out[42]:





{'n_neighbors': 23, 'weights': 'uniform'}



In [43]:

    
clf = KNeighborsClassifier(n_neighbors=23, weights='uniform')
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 2 ms






    Out[43]:





KNeighborsClassifier(algorithm='auto', leaf_size=30, metric='minkowski',
           metric_params=None, n_jobs=1, n_neighbors=23, p=2,
           weights='uniform')



In [44]:

    
plotPrediction(clf, X_train_2_dim[:, 1], X_train_2_dim[:, 0], 
               'Age', 'Max Speed', y_train,
                title="Train Data, KNN, k=23",
                fname='knn23-train.png')

A rule of thumb: Smoother decision boundaries imply less overfitting



In [45]:

    
clf.score(X_train_2_dim, y_train)









    Out[45]:





0.7322222222222222



In [46]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, KNN, k=23",
                fname='knn23-test.png')



In [47]:

    
clf.score(X_test_2_dim, y_test)









    Out[47]:





0.7216666666666667



In [48]:

    
scores = cross_val_score(clf, X_train_2_dim, y_train, n_jobs=-1)
scores









    Out[48]:





array([0.68106312, 0.74666667, 0.69565217])



In [49]:

    
print("Accuracy: %0.2f (+/- %0.2f)" % (scores.mean(), scores.std() * 2))









    



Accuracy: 0.71 (+/- 0.06)

Descision Trees

Another learning strategy, just like KNN is one
Splits our data set on a certain variable
Similar to what we have done in the manual classifier, but here the rules are actually learned



In [50]:

    
from sklearn.tree import DecisionTreeClassifier
clf = DecisionTreeClassifier()
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 2 ms






    Out[50]:





DecisionTreeClassifier(class_weight=None, criterion='gini', max_depth=None,
            max_features=None, max_leaf_nodes=None,
            min_impurity_decrease=0.0, min_impurity_split=None,
            min_samples_leaf=1, min_samples_split=2,
            min_weight_fraction_leaf=0.0, presort=False, random_state=None,
            splitter='best')



In [51]:

    
# we perform at most 20 splits of our data until we make a decision where the data point belongs

clf.tree_.max_depth









    Out[51]:





22



In [52]:

    
plotPrediction(clf, X_train_2_dim[:, 1], X_train_2_dim[:, 0], 
               'Age', 'Max Speed', y_train,
                title="Train Data, Decision Tree",
                fname='dt-overfit-train.png')



In [53]:

    
clf.score(X_train_2_dim, y_train)









    Out[53]:





0.9633333333333334



In [54]:

    
scores = cross_val_score(clf, X_train_2_dim, y_train, n_jobs=-1)
scores









    Out[54]:





array([0.56810631, 0.61333333, 0.63879599])



In [55]:

    
print("Accuracy: %0.2f (+/- %0.2f)" % (scores.mean(), scores.std() * 2))









    



Accuracy: 0.61 (+/- 0.06)



In [56]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, Decision Tree",
                fname='dt-overfit-test.png')



In [57]:

    
clf.score(X_test_2_dim, y_test)









    Out[57]:





0.6066666666666667

We overfit heavily and need to change the relevant parameters of our tree

its maximum number of spits (depth) - if there is no limit, we can make as many splits as it takes to perfectly match all train data (overfitting)
how many samples we need at least for a leaf - if it is just one, we could perfectly fit all training data (overfitting)
how many samples do we need to make another split - not as crucial as the other two, but can still limit overfitting



In [58]:

    
param_grid = {
    'max_depth': list(range(2, 25)),
    'min_samples_split': list(range(2, 11)),
    'min_samples_leaf': list(range(1, 11))
}
clf = GridSearchCV(DecisionTreeClassifier(), param_grid, n_jobs=-1)
%time clf.fit(X_train_2_dim, y_train)
clf.best_params_









    



Wall time: 9.2 s






    Out[58]:





{'max_depth': 6, 'min_samples_leaf': 1, 'min_samples_split': 3}



In [59]:

    
clf = DecisionTreeClassifier(max_depth=7,
                              min_samples_leaf=4,
                              min_samples_split=19)
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 1 ms






    Out[59]:





DecisionTreeClassifier(class_weight=None, criterion='gini', max_depth=7,
            max_features=None, max_leaf_nodes=None,
            min_impurity_decrease=0.0, min_impurity_split=None,
            min_samples_leaf=4, min_samples_split=19,
            min_weight_fraction_leaf=0.0, presort=False, random_state=None,
            splitter='best')



In [60]:

    
clf.tree_.max_depth









    Out[60]:





7



In [61]:

    
plotPrediction(clf, X_train_2_dim[:, 1], X_train_2_dim[:, 0], 
               'Age', 'Max Speed', y_train,
                title="Train Data, Regularized Decision Tree",
                fname='dt-sweet-train.png')



In [62]:

    
clf.score(X_train_2_dim, y_train)









    Out[62]:





0.7677777777777778



In [63]:

    
scores = cross_val_score(clf, X_train_2_dim, y_train, n_jobs=-1)
scores









    Out[63]:





array([0.69435216, 0.73333333, 0.68227425])



In [64]:

    
print("Accuracy: %0.2f (+/- %0.2f)" % (scores.mean(), scores.std() * 2))









    



Accuracy: 0.70 (+/- 0.04)



In [65]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, Regularized Decision Tree",
                fname='dt-sweet-test.png')



In [66]:

    
clf.score(X_test_2_dim, y_test)









    Out[66]:





0.7

Random Forest

We fight overfitting in decision trees with some success
However, inherent to their nature, decision trees tend to overfit
Random Forest is an ensemble technique that trains a number of simple decision trees and uses a majority vote over all of them for prediction
While each decision tree still overfits using many of them softens this problems
You still need to regularize the underlying decision trees
sklearn has a default of 10 decision trees for random forest
Random Forest is the swiss army knife of machine learning



In [67]:

    
from sklearn.ensemble import RandomForestClassifier
clf = RandomForestClassifier(n_jobs=-1)
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 119 ms






    Out[67]:





RandomForestClassifier(bootstrap=True, class_weight=None, criterion='gini',
            max_depth=None, max_features='auto', max_leaf_nodes=None,
            min_impurity_decrease=0.0, min_impurity_split=None,
            min_samples_leaf=1, min_samples_split=2,
            min_weight_fraction_leaf=0.0, n_estimators=10, n_jobs=-1,
            oob_score=False, random_state=None, verbose=0,
            warm_start=False)



In [68]:

    
clf.score(X_train_2_dim, y_train)









    Out[68]:





0.9366666666666666



In [69]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, Random Forest",
                fname='rf-overfit-train.png')



In [70]:

    
clf.score(X_test_2_dim, y_test)









    Out[70]:





0.6516666666666666



In [71]:

    
# brute force grid search is far too expensive

param_grid = {
    'n_estimators': list(range(3,20)),
    'max_depth': list(range(2, 25)),
    'min_samples_split': list(range(2, 11)),
    'min_samples_leaf': list(range(1, 11))
}
clf = GridSearchCV(RandomForestClassifier(), param_grid, n_jobs=-1)
# %time clf.fit(X_train_2_dim, y_train)
# clf.best_params_

Unfortunately, training random forest classifiers is more expensive than decision trees by the number of estimators it uses (10 in our case). This makes using a deterministic grid search over all parameters prohibitively expensive. We instead use a randomized search, that tries 100 different values and we hope to find the best here.



In [72]:

    
# http://scikit-learn.org/stable/modules/grid_search.html#randomized-parameter-search
from sklearn.model_selection import RandomizedSearchCV
from scipy.stats import randint

param_dist = {
    'n_estimators': randint(3,20),
    "max_depth": randint(2, 25),
    "min_samples_split": randint(2, 11),
    "min_samples_leaf": randint(1, 11)
}

clf = RandomizedSearchCV(RandomForestClassifier(), param_dist, n_iter=1000, n_jobs=-1)
%time clf.fit(X_train_2_dim, y_train)
clf.best_params_









    



Wall time: 19.3 s






    Out[72]:





{'max_depth': 5,
 'min_samples_leaf': 1,
 'min_samples_split': 4,
 'n_estimators': 14}



In [73]:

    
# parameters might vary a bit with each run, because it is a random search
clf = RandomForestClassifier(max_depth=5, min_samples_leaf=3, min_samples_split=3, n_estimators=17, n_jobs=-1)
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 125 ms






    Out[73]:





RandomForestClassifier(bootstrap=True, class_weight=None, criterion='gini',
            max_depth=5, max_features='auto', max_leaf_nodes=None,
            min_impurity_decrease=0.0, min_impurity_split=None,
            min_samples_leaf=3, min_samples_split=3,
            min_weight_fraction_leaf=0.0, n_estimators=17, n_jobs=-1,
            oob_score=False, random_state=None, verbose=0,
            warm_start=False)



In [74]:

    
clf.score(X_train_2_dim, y_train)









    Out[74]:





0.7533333333333333



In [75]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, Regularized Random Forest",
                fname='rf-sweet-test.png')



In [76]:

    
clf.score(X_test_2_dim, y_test)









    Out[76]:





0.715

Support Vector Machines (SVM)

SVMs used to be the hot stuff before neural networks stole the show
SVMs choose a small number of data points to decide where to draw the decision boundary, they are called the support vectors

In its base version SVMs can only use lines as decision boundaries. Let's see how well this works.



In [77]:

    
from sklearn.svm import SVC
clf = SVC(kernel='linear')
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 337 ms






    Out[77]:





SVC(C=1.0, cache_size=200, class_weight=None, coef0=0.0,
  decision_function_shape='ovr', degree=3, gamma='auto', kernel='linear',
  max_iter=-1, probability=False, random_state=None, shrinking=True,
  tol=0.001, verbose=False)



In [78]:

    
clf.score(X_train_2_dim, y_train)









    Out[78]:





0.4166666666666667



In [79]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, SVM linear Kernel",
                fname='svm-underfit-linear-train.png')

SVM Kernels

As we can see using lines only, we can not even fit the training data, this is called underfitting.
For most realisitic examples we need something better called the 'kernel trick'
We transform the original problem space into another that is separable by lines only
Radial Base Functions 'rbf' can approximate any function and are trained to perform this transformation



In [80]:

    
from sklearn.svm import SVC
clf = SVC()
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 47 ms






    Out[80]:





SVC(C=1.0, cache_size=200, class_weight=None, coef0=0.0,
  decision_function_shape='ovr', degree=3, gamma='auto', kernel='rbf',
  max_iter=-1, probability=False, random_state=None, shrinking=True,
  tol=0.001, verbose=False)



In [81]:

    
clf.score(X_train_2_dim, y_train)









    Out[81]:





0.9166666666666666



In [82]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, SVM rbf Kernel",
                fname='svm-overfit-test.png')



In [83]:

    
clf.score(X_test_2_dim, y_test)









    Out[83]:





0.6533333333333333



In [84]:

    
# SVC?

Again we strongly overfit and need to regularize our model. The two important parameters are

C: decides how expensive it is to misclassify one of our support vectors, the smaller the more tolerant
gamma: the higher the more points remote from the support vectors influence where the decision boundaries go



In [85]:

    
param_grid = {
    'C': list(np.append(np.arange(0.1, 1.0, 0.1), np.arange(2, 10, 1))),
    'gamma': list(np.append(np.arange(0.001, 0.1, 0.0005), np.arange(.02, 1.0, 0.1))),
}
clf = GridSearchCV(SVC(), param_grid, n_jobs=-1)
%time clf.fit(X_train_2_dim, y_train)
clf.best_params_









    



Wall time: 1min 3s






    Out[85]:





{'C': 8.0, 'gamma': 0.001}



In [86]:

    
clf = SVC(C=8, gamma=0.001)
%time clf.fit(X_train_2_dim, y_train)









    



Wall time: 27 ms






    Out[86]:





SVC(C=8, cache_size=200, class_weight=None, coef0=0.0,
  decision_function_shape='ovr', degree=3, gamma=0.001, kernel='rbf',
  max_iter=-1, probability=False, random_state=None, shrinking=True,
  tol=0.001, verbose=False)



In [87]:

    
clf.score(X_train_2_dim, y_train)









    Out[87]:





0.7333333333333333



In [88]:

    
plotPrediction(clf, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, SVM Regularized rbf Kernel",
                fname='svm-reg-test.png')



In [89]:

    
clf.score(X_test_2_dim, y_test)









    Out[89]:





0.73

Important if you let this run on Colab switch on the GPU option, because otherwise this part will take quite some time

Neural Networks using TensorFlow and Keras Layers

Neural Networks consist of artificial neurons you organize in layers
each neuron is very simple, but, theoretically, having enough of them in a single layer can approximate any funtion
practically, we use 2 or 3 layers, as this has turned out to work well
the more neurons and the more layers you use the longer the network takes to train
neural networks often are no longer approachable using cross validation and grid search to find suitable hyper parameters

Neuron (aka node or unit)

A neuron takes a number of numerical inputs, multiplies each with a weight, sums up all weighted input and adds bias (constant) to that sum. From this it creates a single numerical output. For one input (one dimension) this would be a description of a line. For more dimensions this describes a hyper plane that can serve as a decision boundary. Typically, this output is transformed using an activation function which compresses the output to a value between 0 and 1 (sigmoid), or between -1 and 1 (tanh) or sets all negative values to zero (relu).

It is not really important to understand the details of a neural network. Practically how you configure them to form something more powerful is much more important. This, however, is still a very experimental domain, so there really is no conscise explanation and understanding how they work.



In [90]:

    
import tensorflow as tf
tf.logging.set_verbosity(tf.logging.ERROR)
print(tf.__version__)



In [91]:

    
# let's see what compute devices we have available, hopefully a GPU
sess = tf.Session()
devices = sess.list_devices()
for d in devices:
    print(d.name)
hello = tf.constant('Hello TF!')
print(sess.run(hello))









    



/job:localhost/replica:0/task:0/device:CPU:0
/job:localhost/replica:0/task:0/device:GPU:0
b'Hello TF!'



In [92]:

    
# tiny little pieces of feature engeneering, we need a one-hot-encoding for our 3 groups
num_categories = 3

y_train_categorical = tf.keras.utils.to_categorical(y_train, num_categories)
y_test_categorical = tf.keras.utils.to_categorical(y_test, num_categories)

We start with two layers each having 500 neurons



In [93]:

    
# tf.keras.layers.Dense?



In [94]:

    
model = tf.keras.Sequential()

model.add(tf.keras.layers.Dense(500, name='hidden1', activation='tanh', input_dim=2))
model.add(tf.keras.layers.Dense(500, name='hidden2', activation='tanh'))
# model.add(tf.keras.layers.Dense(500, name='hidden1', activation='relu', input_dim=2))
# model.add(tf.keras.layers.Dense(500, name='hidden2', activation='relu'))

model.add(tf.keras.layers.Dense(num_categories, name='softmax', activation='softmax'))

model.summary()









    



_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
hidden1 (Dense)              (None, 500)               1500      
_________________________________________________________________
hidden2 (Dense)              (None, 500)               250500    
_________________________________________________________________
softmax (Dense)              (None, 3)                 1503      
=================================================================
Total params: 253,503
Trainable params: 253,503
Non-trainable params: 0
_________________________________________________________________



In [95]:

    
# tf.keras.optimizers.Adam?



In [96]:

    
# https://keras.io/optimizers/
sgd = tf.keras.optimizers.SGD(lr=1, decay=1e-6, momentum=0.9, nesterov=True)
adam = tf.keras.optimizers.Adam(lr=1)

model.compile(loss='categorical_crossentropy',
             optimizer='adam',
#              optimizer=adam,
#              optimizer=sgd,
             metrics=['accuracy'])

If you do not train for too long, even without any further regularization this network will not overfit by too much, but look at how strange the decision boundaries look like



In [97]:

    
BATCH_SIZE=1000
EPOCHS = 2000

early_stopping = tf.keras.callbacks.EarlyStopping(monitor='val_loss', patience=100, verbose=1)
# checkpoint = tf.keras.callbacks.ModelCheckpoint('keras-model.epoch-{epoch:02d}-val_loss-{val_loss:.2f}.hdf5',
#                                                 verbose = 1, save_best_only=True)
checkpoint = tf.keras.callbacks.ModelCheckpoint('keras-model.hdf5', verbose = 1, save_best_only=True)

# %time model.fit(X_train_2_dim, y_train_categorical, epochs=EPOCHS, batch_size=BATCH_SIZE, validation_split=0.2, callbacks=[checkpoint, early_stopping])
%time model.fit(X_train_2_dim, y_train_categorical, epochs=EPOCHS, batch_size=BATCH_SIZE, validation_split=0.2)









    



Train on 720 samples, validate on 180 samples
Epoch 1/2000
720/720 [==============================] - 1s 1ms/step - loss: 1.3663 - acc: 0.3306 - val_loss: 3.9424 - val_acc: 0.3278
Epoch 2/2000
720/720 [==============================] - 0s 12us/step - loss: 3.8771 - acc: 0.3361 - val_loss: 5.0490 - val_acc: 0.3333
Epoch 3/2000
720/720 [==============================] - 0s 12us/step - loss: 5.0011 - acc: 0.3333 - val_loss: 3.5175 - val_acc: 0.3333
Epoch 4/2000
720/720 [==============================] - 0s 14us/step - loss: 3.4793 - acc: 0.3333 - val_loss: 2.0911 - val_acc: 0.3278
Epoch 5/2000
720/720 [==============================] - 0s 12us/step - loss: 2.0466 - acc: 0.3361 - val_loss: 1.5414 - val_acc: 0.3278
Epoch 6/2000
720/720 [==============================] - 0s 12us/step - loss: 1.5111 - acc: 0.3361 - val_loss: 2.1364 - val_acc: 0.3389
Epoch 7/2000
720/720 [==============================] - 0s 12us/step - loss: 2.1378 - acc: 0.3306 - val_loss: 2.3543 - val_acc: 0.3389
Epoch 8/2000
720/720 [==============================] - 0s 12us/step - loss: 2.3602 - acc: 0.3306 - val_loss: 1.7241 - val_acc: 0.3389
Epoch 9/2000
720/720 [==============================] - 0s 15us/step - loss: 1.7214 - acc: 0.3306 - val_loss: 1.0855 - val_acc: 0.3389
Epoch 10/2000
720/720 [==============================] - 0s 14us/step - loss: 1.0683 - acc: 0.3306 - val_loss: 1.1003 - val_acc: 0.5111
Epoch 11/2000
720/720 [==============================] - 0s 11us/step - loss: 1.0716 - acc: 0.5306 - val_loss: 1.3388 - val_acc: 0.5000
Epoch 12/2000
720/720 [==============================] - 0s 11us/step - loss: 1.3018 - acc: 0.5153 - val_loss: 1.4800 - val_acc: 0.5167
Epoch 13/2000
720/720 [==============================] - 0s 11us/step - loss: 1.4357 - acc: 0.5236 - val_loss: 1.5034 - val_acc: 0.5167
Epoch 14/2000
720/720 [==============================] - 0s 11us/step - loss: 1.4530 - acc: 0.5417 - val_loss: 1.4392 - val_acc: 0.5389
Epoch 15/2000
720/720 [==============================] - 0s 11us/step - loss: 1.3854 - acc: 0.5528 - val_loss: 1.3096 - val_acc: 0.5111
Epoch 16/2000
720/720 [==============================] - 0s 11us/step - loss: 1.2567 - acc: 0.5528 - val_loss: 1.1502 - val_acc: 0.5333
Epoch 17/2000
720/720 [==============================] - 0s 11us/step - loss: 1.1025 - acc: 0.5542 - val_loss: 1.0261 - val_acc: 0.5222
Epoch 18/2000
720/720 [==============================] - 0s 11us/step - loss: 0.9864 - acc: 0.5528 - val_loss: 0.9983 - val_acc: 0.5111
Epoch 19/2000
720/720 [==============================] - 0s 13us/step - loss: 0.9665 - acc: 0.5264 - val_loss: 1.0582 - val_acc: 0.3444
Epoch 20/2000
720/720 [==============================] - 0s 11us/step - loss: 1.0315 - acc: 0.3597 - val_loss: 1.1286 - val_acc: 0.3389
Epoch 21/2000
720/720 [==============================] - 0s 13us/step - loss: 1.1032 - acc: 0.3306 - val_loss: 1.1488 - val_acc: 0.3389
Epoch 22/2000
720/720 [==============================] - 0s 13us/step - loss: 1.1208 - acc: 0.3306 - val_loss: 1.1157 - val_acc: 0.3500
Epoch 23/2000
720/720 [==============================] - 0s 13us/step - loss: 1.0816 - acc: 0.3667 - val_loss: 1.0630 - val_acc: 0.4167
Epoch 24/2000
720/720 [==============================] - 0s 11us/step - loss: 1.0205 - acc: 0.4319 - val_loss: 1.0210 - val_acc: 0.4389
Epoch 25/2000
720/720 [==============================] - 0s 13us/step - loss: 0.9700 - acc: 0.4528 - val_loss: 0.9967 - val_acc: 0.4556
Epoch 26/2000
720/720 [==============================] - 0s 13us/step - loss: 0.9408 - acc: 0.5528 - val_loss: 0.9924 - val_acc: 0.5167
Epoch 27/2000
720/720 [==============================] - 0s 12us/step - loss: 0.9364 - acc: 0.5514 - val_loss: 1.0103 - val_acc: 0.5333
Epoch 28/2000
720/720 [==============================] - 0s 11us/step - loss: 0.9575 - acc: 0.5514 - val_loss: 1.0338 - val_acc: 0.5333
Epoch 29/2000
720/720 [==============================] - 0s 11us/step - loss: 0.9829 - acc: 0.5389 - val_loss: 1.0407 - val_acc: 0.5222
Epoch 30/2000
720/720 [==============================] - 0s 13us/step - loss: 0.9872 - acc: 0.5361 - val_loss: 1.0320 - val_acc: 0.5278
Epoch 31/2000
720/720 [==============================] - 0s 22us/step - loss: 0.9719 - acc: 0.5542 - val_loss: 1.0210 - val_acc: 0.5222
Epoch 32/2000
720/720 [==============================] - 0s 24us/step - loss: 0.9538 - acc: 0.5556 - val_loss: 1.0074 - val_acc: 0.5000
Epoch 33/2000
720/720 [==============================] - 0s 14us/step - loss: 0.9372 - acc: 0.5486 - val_loss: 0.9854 - val_acc: 0.5000
Epoch 34/2000
720/720 [==============================] - 0s 14us/step - loss: 0.9184 - acc: 0.5500 - val_loss: 0.9673 - val_acc: 0.5056
Epoch 35/2000
720/720 [==============================] - 0s 12us/step - loss: 0.9073 - acc: 0.5569 - val_loss: 0.9679 - val_acc: 0.5333
Epoch 36/2000
720/720 [==============================] - 0s 13us/step - loss: 0.9134 - acc: 0.5583 - val_loss: 0.9795 - val_acc: 0.5000
Epoch 37/2000
720/720 [==============================] - 0s 12us/step - loss: 0.9254 - acc: 0.5472 - val_loss: 0.9863 - val_acc: 0.4556
Epoch 38/2000
720/720 [==============================] - 0s 11us/step - loss: 0.9277 - acc: 0.5264 - val_loss: 0.9881 - val_acc: 0.4500
Epoch 39/2000
720/720 [==============================] - 0s 11us/step - loss: 0.9215 - acc: 0.5208 - val_loss: 0.9891 - val_acc: 0.4611
Epoch 40/2000
720/720 [==============================] - 0s 13us/step - loss: 0.9143 - acc: 0.5403 - val_loss: 0.9868 - val_acc: 0.5000
Epoch 41/2000
720/720 [==============================] - 0s 11us/step - loss: 0.9067 - acc: 0.5625 - val_loss: 0.9792 - val_acc: 0.5056
Epoch 42/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8983 - acc: 0.5653 - val_loss: 0.9732 - val_acc: 0.5278
Epoch 43/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8954 - acc: 0.5667 - val_loss: 0.9742 - val_acc: 0.5500
Epoch 44/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8993 - acc: 0.5708 - val_loss: 0.9775 - val_acc: 0.5500
Epoch 45/2000
720/720 [==============================] - 0s 13us/step - loss: 0.9018 - acc: 0.5694 - val_loss: 0.9812 - val_acc: 0.5333
Epoch 46/2000
720/720 [==============================] - 0s 13us/step - loss: 0.9003 - acc: 0.5625 - val_loss: 0.9857 - val_acc: 0.5444
Epoch 47/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8993 - acc: 0.5653 - val_loss: 0.9854 - val_acc: 0.5333
Epoch 48/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8972 - acc: 0.5653 - val_loss: 0.9776 - val_acc: 0.5056
Epoch 49/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8925 - acc: 0.5611 - val_loss: 0.9704 - val_acc: 0.5389
Epoch 50/2000
720/720 [==============================] - 0s 25us/step - loss: 0.8906 - acc: 0.5722 - val_loss: 0.9693 - val_acc: 0.5278
Epoch 51/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8916 - acc: 0.5792 - val_loss: 0.9719 - val_acc: 0.5222
Epoch 52/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8914 - acc: 0.5722 - val_loss: 0.9770 - val_acc: 0.5167
Epoch 53/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8914 - acc: 0.5792 - val_loss: 0.9796 - val_acc: 0.5167
Epoch 54/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8907 - acc: 0.5764 - val_loss: 0.9756 - val_acc: 0.5056
Epoch 55/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8874 - acc: 0.5792 - val_loss: 0.9703 - val_acc: 0.5333
Epoch 56/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8850 - acc: 0.5833 - val_loss: 0.9687 - val_acc: 0.5333
Epoch 57/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8846 - acc: 0.5847 - val_loss: 0.9704 - val_acc: 0.5500
Epoch 58/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8835 - acc: 0.5792 - val_loss: 0.9742 - val_acc: 0.5278
Epoch 59/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8831 - acc: 0.5792 - val_loss: 0.9758 - val_acc: 0.5056
Epoch 60/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8828 - acc: 0.5778 - val_loss: 0.9725 - val_acc: 0.5056
Epoch 61/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8812 - acc: 0.5750 - val_loss: 0.9685 - val_acc: 0.5278
Epoch 62/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8805 - acc: 0.5889 - val_loss: 0.9676 - val_acc: 0.5333
Epoch 63/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8803 - acc: 0.5917 - val_loss: 0.9695 - val_acc: 0.5222
Epoch 64/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8795 - acc: 0.5903 - val_loss: 0.9719 - val_acc: 0.5111
Epoch 65/2000
720/720 [==============================] - 0s 18us/step - loss: 0.8792 - acc: 0.5819 - val_loss: 0.9708 - val_acc: 0.5167
Epoch 66/2000
720/720 [==============================] - 0s 17us/step - loss: 0.8781 - acc: 0.5847 - val_loss: 0.9675 - val_acc: 0.5333
Epoch 67/2000
720/720 [==============================] - 0s 29us/step - loss: 0.8769 - acc: 0.5875 - val_loss: 0.9657 - val_acc: 0.5333
Epoch 68/2000
720/720 [==============================] - 0s 15us/step - loss: 0.8763 - acc: 0.5903 - val_loss: 0.9662 - val_acc: 0.5333
Epoch 69/2000
720/720 [==============================] - 0s 15us/step - loss: 0.8755 - acc: 0.5889 - val_loss: 0.9675 - val_acc: 0.5167
Epoch 70/2000
720/720 [==============================] - 0s 17us/step - loss: 0.8750 - acc: 0.5861 - val_loss: 0.9668 - val_acc: 0.5167
Epoch 71/2000
720/720 [==============================] - 0s 26us/step - loss: 0.8744 - acc: 0.5875 - val_loss: 0.9643 - val_acc: 0.5278
Epoch 72/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8738 - acc: 0.5889 - val_loss: 0.9635 - val_acc: 0.5333
Epoch 73/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8732 - acc: 0.5875 - val_loss: 0.9640 - val_acc: 0.5333
Epoch 74/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8726 - acc: 0.5903 - val_loss: 0.9639 - val_acc: 0.5333
Epoch 75/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8721 - acc: 0.5903 - val_loss: 0.9625 - val_acc: 0.5389
Epoch 76/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8713 - acc: 0.5875 - val_loss: 0.9612 - val_acc: 0.5333
Epoch 77/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8705 - acc: 0.5903 - val_loss: 0.9611 - val_acc: 0.5444
Epoch 78/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8698 - acc: 0.5931 - val_loss: 0.9618 - val_acc: 0.5389
Epoch 79/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8692 - acc: 0.5903 - val_loss: 0.9618 - val_acc: 0.5389
Epoch 80/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8685 - acc: 0.5917 - val_loss: 0.9610 - val_acc: 0.5333
Epoch 81/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8680 - acc: 0.5917 - val_loss: 0.9609 - val_acc: 0.5278
Epoch 82/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8674 - acc: 0.5917 - val_loss: 0.9609 - val_acc: 0.5278
Epoch 83/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8668 - acc: 0.5917 - val_loss: 0.9598 - val_acc: 0.5389
Epoch 84/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8662 - acc: 0.5903 - val_loss: 0.9586 - val_acc: 0.5389
Epoch 85/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8656 - acc: 0.5917 - val_loss: 0.9586 - val_acc: 0.5333
Epoch 86/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8650 - acc: 0.5903 - val_loss: 0.9579 - val_acc: 0.5389
Epoch 87/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8643 - acc: 0.5931 - val_loss: 0.9563 - val_acc: 0.5556
Epoch 88/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8637 - acc: 0.5944 - val_loss: 0.9557 - val_acc: 0.5556
Epoch 89/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8630 - acc: 0.5944 - val_loss: 0.9557 - val_acc: 0.5500
Epoch 90/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8623 - acc: 0.5903 - val_loss: 0.9545 - val_acc: 0.5500
Epoch 91/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8616 - acc: 0.5958 - val_loss: 0.9541 - val_acc: 0.5611
Epoch 92/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8608 - acc: 0.6014 - val_loss: 0.9555 - val_acc: 0.5611
Epoch 93/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8603 - acc: 0.6000 - val_loss: 0.9557 - val_acc: 0.5611
Epoch 94/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8598 - acc: 0.5986 - val_loss: 0.9554 - val_acc: 0.5722
Epoch 95/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8592 - acc: 0.6028 - val_loss: 0.9547 - val_acc: 0.5722
Epoch 96/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8585 - acc: 0.6056 - val_loss: 0.9535 - val_acc: 0.5722
Epoch 97/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8579 - acc: 0.6083 - val_loss: 0.9523 - val_acc: 0.5778
Epoch 98/2000
720/720 [==============================] - 0s 24us/step - loss: 0.8573 - acc: 0.6042 - val_loss: 0.9515 - val_acc: 0.5778
Epoch 99/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8567 - acc: 0.6028 - val_loss: 0.9509 - val_acc: 0.5833
Epoch 100/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8560 - acc: 0.6083 - val_loss: 0.9506 - val_acc: 0.5889
Epoch 101/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8553 - acc: 0.6125 - val_loss: 0.9505 - val_acc: 0.5889
Epoch 102/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8547 - acc: 0.6125 - val_loss: 0.9499 - val_acc: 0.5889
Epoch 103/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8540 - acc: 0.6125 - val_loss: 0.9491 - val_acc: 0.5889
Epoch 104/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8533 - acc: 0.6111 - val_loss: 0.9484 - val_acc: 0.5944
Epoch 105/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8527 - acc: 0.6153 - val_loss: 0.9482 - val_acc: 0.5944
Epoch 106/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8521 - acc: 0.6153 - val_loss: 0.9481 - val_acc: 0.6000
Epoch 107/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8515 - acc: 0.6208 - val_loss: 0.9481 - val_acc: 0.6000
Epoch 108/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8509 - acc: 0.6222 - val_loss: 0.9479 - val_acc: 0.6000
Epoch 109/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8503 - acc: 0.6236 - val_loss: 0.9473 - val_acc: 0.6000
Epoch 110/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8497 - acc: 0.6278 - val_loss: 0.9467 - val_acc: 0.6000
Epoch 111/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8491 - acc: 0.6292 - val_loss: 0.9457 - val_acc: 0.6000
Epoch 112/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8485 - acc: 0.6292 - val_loss: 0.9456 - val_acc: 0.6000
Epoch 113/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8479 - acc: 0.6292 - val_loss: 0.9440 - val_acc: 0.6056
Epoch 114/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8473 - acc: 0.6292 - val_loss: 0.9457 - val_acc: 0.5944
Epoch 115/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8468 - acc: 0.6292 - val_loss: 0.9416 - val_acc: 0.6056
Epoch 116/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8465 - acc: 0.6333 - val_loss: 0.9489 - val_acc: 0.5889
Epoch 117/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8468 - acc: 0.6125 - val_loss: 0.9393 - val_acc: 0.6111
Epoch 118/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8471 - acc: 0.6292 - val_loss: 0.9491 - val_acc: 0.5889
Epoch 119/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8461 - acc: 0.6125 - val_loss: 0.9408 - val_acc: 0.6056
Epoch 120/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8439 - acc: 0.6347 - val_loss: 0.9399 - val_acc: 0.6111
Epoch 121/2000
720/720 [==============================] - 0s 25us/step - loss: 0.8437 - acc: 0.6319 - val_loss: 0.9482 - val_acc: 0.6000
Epoch 122/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8443 - acc: 0.6208 - val_loss: 0.9384 - val_acc: 0.6056
Epoch 123/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8431 - acc: 0.6292 - val_loss: 0.9407 - val_acc: 0.6056
Epoch 124/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8416 - acc: 0.6361 - val_loss: 0.9425 - val_acc: 0.6000
Epoch 125/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8415 - acc: 0.6333 - val_loss: 0.9359 - val_acc: 0.6111
Epoch 126/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8417 - acc: 0.6264 - val_loss: 0.9426 - val_acc: 0.6000
Epoch 127/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8407 - acc: 0.6333 - val_loss: 0.9377 - val_acc: 0.6056
Epoch 128/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8394 - acc: 0.6389 - val_loss: 0.9363 - val_acc: 0.6056
Epoch 129/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8391 - acc: 0.6347 - val_loss: 0.9423 - val_acc: 0.6056
Epoch 130/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8392 - acc: 0.6333 - val_loss: 0.9345 - val_acc: 0.6111
Epoch 131/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8386 - acc: 0.6306 - val_loss: 0.9386 - val_acc: 0.6000
Epoch 132/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8375 - acc: 0.6375 - val_loss: 0.9367 - val_acc: 0.6056
Epoch 133/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8368 - acc: 0.6375 - val_loss: 0.9336 - val_acc: 0.6111
Epoch 134/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8366 - acc: 0.6361 - val_loss: 0.9392 - val_acc: 0.6056
Epoch 135/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8365 - acc: 0.6375 - val_loss: 0.9318 - val_acc: 0.6222
Epoch 136/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8359 - acc: 0.6319 - val_loss: 0.9360 - val_acc: 0.6000
Epoch 137/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8349 - acc: 0.6403 - val_loss: 0.9323 - val_acc: 0.6056
Epoch 138/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8341 - acc: 0.6389 - val_loss: 0.9315 - val_acc: 0.6056
Epoch 139/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8336 - acc: 0.6389 - val_loss: 0.9346 - val_acc: 0.6000
Epoch 140/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8335 - acc: 0.6375 - val_loss: 0.9288 - val_acc: 0.6222
Epoch 141/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8334 - acc: 0.6319 - val_loss: 0.9366 - val_acc: 0.6056
Epoch 142/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8334 - acc: 0.6403 - val_loss: 0.9275 - val_acc: 0.6222
Epoch 143/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8331 - acc: 0.6306 - val_loss: 0.9362 - val_acc: 0.6056
Epoch 144/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8324 - acc: 0.6403 - val_loss: 0.9271 - val_acc: 0.6222
Epoch 145/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8314 - acc: 0.6333 - val_loss: 0.9319 - val_acc: 0.6000
Epoch 146/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8303 - acc: 0.6389 - val_loss: 0.9285 - val_acc: 0.6167
Epoch 147/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8296 - acc: 0.6403 - val_loss: 0.9282 - val_acc: 0.6167
Epoch 148/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8291 - acc: 0.6403 - val_loss: 0.9315 - val_acc: 0.6056
Epoch 149/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8290 - acc: 0.6375 - val_loss: 0.9258 - val_acc: 0.6222
Epoch 150/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8291 - acc: 0.6333 - val_loss: 0.9347 - val_acc: 0.6056
Epoch 151/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8294 - acc: 0.6431 - val_loss: 0.9238 - val_acc: 0.6222
Epoch 152/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8299 - acc: 0.6292 - val_loss: 0.9374 - val_acc: 0.6000
Epoch 153/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8302 - acc: 0.6417 - val_loss: 0.9228 - val_acc: 0.6222
Epoch 154/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8293 - acc: 0.6292 - val_loss: 0.9326 - val_acc: 0.6056
Epoch 155/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8275 - acc: 0.6444 - val_loss: 0.9246 - val_acc: 0.6167
Epoch 156/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8257 - acc: 0.6347 - val_loss: 0.9248 - val_acc: 0.6111
Epoch 157/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8252 - acc: 0.6361 - val_loss: 0.9309 - val_acc: 0.6056
Epoch 158/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8257 - acc: 0.6417 - val_loss: 0.9219 - val_acc: 0.6222
Epoch 159/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8262 - acc: 0.6319 - val_loss: 0.9328 - val_acc: 0.6056
Epoch 160/2000
720/720 [==============================] - 0s 10us/step - loss: 0.8260 - acc: 0.6444 - val_loss: 0.9211 - val_acc: 0.6222
Epoch 161/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8248 - acc: 0.6347 - val_loss: 0.9269 - val_acc: 0.5944
Epoch 162/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8234 - acc: 0.6417 - val_loss: 0.9233 - val_acc: 0.6111
Epoch 163/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8225 - acc: 0.6403 - val_loss: 0.9211 - val_acc: 0.6111
Epoch 164/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8224 - acc: 0.6361 - val_loss: 0.9273 - val_acc: 0.6056
Epoch 165/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8226 - acc: 0.6403 - val_loss: 0.9189 - val_acc: 0.6222
Epoch 166/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8228 - acc: 0.6333 - val_loss: 0.9293 - val_acc: 0.6056
Epoch 167/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8226 - acc: 0.6431 - val_loss: 0.9186 - val_acc: 0.6222
Epoch 168/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8220 - acc: 0.6361 - val_loss: 0.9268 - val_acc: 0.6056
Epoch 169/2000
720/720 [==============================] - 0s 28us/step - loss: 0.8211 - acc: 0.6431 - val_loss: 0.9190 - val_acc: 0.6111
Epoch 170/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8201 - acc: 0.6375 - val_loss: 0.9220 - val_acc: 0.5944
Epoch 171/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8194 - acc: 0.6431 - val_loss: 0.9202 - val_acc: 0.6111
Epoch 172/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8189 - acc: 0.6444 - val_loss: 0.9179 - val_acc: 0.6111
Epoch 173/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8187 - acc: 0.6431 - val_loss: 0.9221 - val_acc: 0.6000
Epoch 174/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8186 - acc: 0.6472 - val_loss: 0.9155 - val_acc: 0.6222
Epoch 175/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8189 - acc: 0.6389 - val_loss: 0.9267 - val_acc: 0.6056
Epoch 176/2000
720/720 [==============================] - 0s 17us/step - loss: 0.8196 - acc: 0.6486 - val_loss: 0.9144 - val_acc: 0.6167
Epoch 177/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8214 - acc: 0.6181 - val_loss: 0.9373 - val_acc: 0.5944
Epoch 178/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8248 - acc: 0.6486 - val_loss: 0.9152 - val_acc: 0.6111
Epoch 179/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8278 - acc: 0.6153 - val_loss: 0.9400 - val_acc: 0.5944
Epoch 180/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8261 - acc: 0.6444 - val_loss: 0.9125 - val_acc: 0.6222
Epoch 181/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8194 - acc: 0.6278 - val_loss: 0.9166 - val_acc: 0.6167
Epoch 182/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8154 - acc: 0.6500 - val_loss: 0.9269 - val_acc: 0.6056
Epoch 183/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8182 - acc: 0.6542 - val_loss: 0.9123 - val_acc: 0.6167
Epoch 184/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8213 - acc: 0.6222 - val_loss: 0.9283 - val_acc: 0.6056
Epoch 185/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8185 - acc: 0.6542 - val_loss: 0.9146 - val_acc: 0.6167
Epoch 186/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8144 - acc: 0.6458 - val_loss: 0.9133 - val_acc: 0.6222
Epoch 187/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8152 - acc: 0.6431 - val_loss: 0.9292 - val_acc: 0.6000
Epoch 188/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8177 - acc: 0.6542 - val_loss: 0.9122 - val_acc: 0.6111
Epoch 189/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8165 - acc: 0.6375 - val_loss: 0.9185 - val_acc: 0.6056
Epoch 190/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8133 - acc: 0.6486 - val_loss: 0.9190 - val_acc: 0.6056
Epoch 191/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8133 - acc: 0.6514 - val_loss: 0.9108 - val_acc: 0.6167
Epoch 192/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8150 - acc: 0.6417 - val_loss: 0.9233 - val_acc: 0.6056
Epoch 193/2000
720/720 [==============================] - 0s 15us/step - loss: 0.8145 - acc: 0.6542 - val_loss: 0.9114 - val_acc: 0.6111
Epoch 194/2000
720/720 [==============================] - 0s 17us/step - loss: 0.8123 - acc: 0.6444 - val_loss: 0.9115 - val_acc: 0.6167
Epoch 195/2000
720/720 [==============================] - 0s 18us/step - loss: 0.8117 - acc: 0.6514 - val_loss: 0.9193 - val_acc: 0.6056
Epoch 196/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8127 - acc: 0.6514 - val_loss: 0.9086 - val_acc: 0.6222
Epoch 197/2000
720/720 [==============================] - 0s 36us/step - loss: 0.8129 - acc: 0.6472 - val_loss: 0.9170 - val_acc: 0.6111
Epoch 198/2000
720/720 [==============================] - 0s 35us/step - loss: 0.8115 - acc: 0.6500 - val_loss: 0.9114 - val_acc: 0.6167
Epoch 199/2000
720/720 [==============================] - 0s 31us/step - loss: 0.8103 - acc: 0.6514 - val_loss: 0.9095 - val_acc: 0.6111
Epoch 200/2000
720/720 [==============================] - 0s 15us/step - loss: 0.8105 - acc: 0.6472 - val_loss: 0.9178 - val_acc: 0.6056
Epoch 201/2000
720/720 [==============================] - 0s 29us/step - loss: 0.8110 - acc: 0.6514 - val_loss: 0.9083 - val_acc: 0.6222
Epoch 202/2000
720/720 [==============================] - 0s 21us/step - loss: 0.8109 - acc: 0.6444 - val_loss: 0.9158 - val_acc: 0.6056
Epoch 203/2000
720/720 [==============================] - 0s 19us/step - loss: 0.8099 - acc: 0.6514 - val_loss: 0.9102 - val_acc: 0.6167
Epoch 204/2000
720/720 [==============================] - 0s 22us/step - loss: 0.8090 - acc: 0.6528 - val_loss: 0.9099 - val_acc: 0.6167
Epoch 205/2000
720/720 [==============================] - 0s 15us/step - loss: 0.8087 - acc: 0.6514 - val_loss: 0.9147 - val_acc: 0.6056
Epoch 206/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8089 - acc: 0.6514 - val_loss: 0.9074 - val_acc: 0.6167
Epoch 207/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8091 - acc: 0.6486 - val_loss: 0.9154 - val_acc: 0.6111
Epoch 208/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8088 - acc: 0.6500 - val_loss: 0.9070 - val_acc: 0.6222
Epoch 209/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8082 - acc: 0.6528 - val_loss: 0.9119 - val_acc: 0.6056
Epoch 210/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8075 - acc: 0.6486 - val_loss: 0.9088 - val_acc: 0.6167
Epoch 211/2000
720/720 [==============================] - 0s 26us/step - loss: 0.8070 - acc: 0.6486 - val_loss: 0.9083 - val_acc: 0.6167
Epoch 212/2000
720/720 [==============================] - 0s 21us/step - loss: 0.8067 - acc: 0.6486 - val_loss: 0.9111 - val_acc: 0.6111
Epoch 213/2000
720/720 [==============================] - 0s 25us/step - loss: 0.8067 - acc: 0.6500 - val_loss: 0.9060 - val_acc: 0.6167
Epoch 214/2000
720/720 [==============================] - 0s 33us/step - loss: 0.8067 - acc: 0.6514 - val_loss: 0.9129 - val_acc: 0.6111
Epoch 215/2000
720/720 [==============================] - 0s 24us/step - loss: 0.8067 - acc: 0.6500 - val_loss: 0.9049 - val_acc: 0.6222
Epoch 216/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8066 - acc: 0.6472 - val_loss: 0.9137 - val_acc: 0.6111
Epoch 217/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8066 - acc: 0.6500 - val_loss: 0.9039 - val_acc: 0.6222
Epoch 218/2000
720/720 [==============================] - 0s 25us/step - loss: 0.8064 - acc: 0.6486 - val_loss: 0.9139 - val_acc: 0.6111
Epoch 219/2000
720/720 [==============================] - 0s 25us/step - loss: 0.8063 - acc: 0.6514 - val_loss: 0.9032 - val_acc: 0.6278
Epoch 220/2000
720/720 [==============================] - 0s 33us/step - loss: 0.8062 - acc: 0.6444 - val_loss: 0.9138 - val_acc: 0.6111
Epoch 221/2000
720/720 [==============================] - 0s 15us/step - loss: 0.8060 - acc: 0.6528 - val_loss: 0.9025 - val_acc: 0.6278
Epoch 222/2000
720/720 [==============================] - 0s 35us/step - loss: 0.8058 - acc: 0.6431 - val_loss: 0.9135 - val_acc: 0.6111
Epoch 223/2000
720/720 [==============================] - 0s 24us/step - loss: 0.8055 - acc: 0.6514 - val_loss: 0.9021 - val_acc: 0.6278
Epoch 224/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8052 - acc: 0.6417 - val_loss: 0.9128 - val_acc: 0.6111
Epoch 225/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8049 - acc: 0.6528 - val_loss: 0.9019 - val_acc: 0.6222
Epoch 226/2000
720/720 [==============================] - 0s 21us/step - loss: 0.8045 - acc: 0.6444 - val_loss: 0.9118 - val_acc: 0.6111
Epoch 227/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8040 - acc: 0.6486 - val_loss: 0.9021 - val_acc: 0.6222
Epoch 228/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8036 - acc: 0.6500 - val_loss: 0.9104 - val_acc: 0.6111
Epoch 229/2000
720/720 [==============================] - 0s 21us/step - loss: 0.8031 - acc: 0.6500 - val_loss: 0.9022 - val_acc: 0.6222
Epoch 230/2000
720/720 [==============================] - 0s 24us/step - loss: 0.8027 - acc: 0.6528 - val_loss: 0.9092 - val_acc: 0.6111
Epoch 231/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8023 - acc: 0.6514 - val_loss: 0.9022 - val_acc: 0.6167
Epoch 232/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8020 - acc: 0.6542 - val_loss: 0.9081 - val_acc: 0.6111
Epoch 233/2000
720/720 [==============================] - 0s 22us/step - loss: 0.8017 - acc: 0.6542 - val_loss: 0.9017 - val_acc: 0.6167
Epoch 234/2000
720/720 [==============================] - 0s 11us/step - loss: 0.8014 - acc: 0.6542 - val_loss: 0.9077 - val_acc: 0.6111
Epoch 235/2000
720/720 [==============================] - 0s 25us/step - loss: 0.8012 - acc: 0.6528 - val_loss: 0.9008 - val_acc: 0.6167
Epoch 236/2000
720/720 [==============================] - 0s 12us/step - loss: 0.8010 - acc: 0.6528 - val_loss: 0.9081 - val_acc: 0.6111
Epoch 237/2000
720/720 [==============================] - 0s 19us/step - loss: 0.8010 - acc: 0.6500 - val_loss: 0.8996 - val_acc: 0.6222
Epoch 238/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8011 - acc: 0.6486 - val_loss: 0.9102 - val_acc: 0.6111
Epoch 239/2000
720/720 [==============================] - 0s 26us/step - loss: 0.8014 - acc: 0.6542 - val_loss: 0.8982 - val_acc: 0.6222
Epoch 240/2000
720/720 [==============================] - 0s 39us/step - loss: 0.8022 - acc: 0.6417 - val_loss: 0.9150 - val_acc: 0.6056
Epoch 241/2000
720/720 [==============================] - 0s 18us/step - loss: 0.8034 - acc: 0.6681 - val_loss: 0.8977 - val_acc: 0.6167
Epoch 242/2000
720/720 [==============================] - 0s 26us/step - loss: 0.8053 - acc: 0.6347 - val_loss: 0.9220 - val_acc: 0.5944
Epoch 243/2000
720/720 [==============================] - 0s 15us/step - loss: 0.8071 - acc: 0.6667 - val_loss: 0.8981 - val_acc: 0.6222
Epoch 244/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8078 - acc: 0.6306 - val_loss: 0.9202 - val_acc: 0.5944
Epoch 245/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8057 - acc: 0.6667 - val_loss: 0.8970 - val_acc: 0.6222
Epoch 246/2000
720/720 [==============================] - 0s 32us/step - loss: 0.8016 - acc: 0.6417 - val_loss: 0.9047 - val_acc: 0.6167
Epoch 247/2000
720/720 [==============================] - 0s 17us/step - loss: 0.7981 - acc: 0.6583 - val_loss: 0.9037 - val_acc: 0.6167
Epoch 248/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7977 - acc: 0.6556 - val_loss: 0.8968 - val_acc: 0.6167
Epoch 249/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7996 - acc: 0.6431 - val_loss: 0.9132 - val_acc: 0.6056
Epoch 250/2000
720/720 [==============================] - 0s 15us/step - loss: 0.8012 - acc: 0.6708 - val_loss: 0.8959 - val_acc: 0.6167
Epoch 251/2000
720/720 [==============================] - 0s 31us/step - loss: 0.8006 - acc: 0.6403 - val_loss: 0.9072 - val_acc: 0.6111
Epoch 252/2000
720/720 [==============================] - 0s 32us/step - loss: 0.7982 - acc: 0.6611 - val_loss: 0.8985 - val_acc: 0.6111
Epoch 253/2000
720/720 [==============================] - 0s 17us/step - loss: 0.7963 - acc: 0.6556 - val_loss: 0.8975 - val_acc: 0.6167
Epoch 254/2000
720/720 [==============================] - 0s 17us/step - loss: 0.7963 - acc: 0.6569 - val_loss: 0.9065 - val_acc: 0.6111
Epoch 255/2000
720/720 [==============================] - 0s 17us/step - loss: 0.7975 - acc: 0.6569 - val_loss: 0.8950 - val_acc: 0.6278
Epoch 256/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7980 - acc: 0.6458 - val_loss: 0.9061 - val_acc: 0.6111
Epoch 257/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7972 - acc: 0.6597 - val_loss: 0.8952 - val_acc: 0.6222
Epoch 258/2000
720/720 [==============================] - 0s 18us/step - loss: 0.7957 - acc: 0.6569 - val_loss: 0.8981 - val_acc: 0.6167
Epoch 259/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7947 - acc: 0.6597 - val_loss: 0.9000 - val_acc: 0.6111
Epoch 260/2000
720/720 [==============================] - 0s 18us/step - loss: 0.7948 - acc: 0.6597 - val_loss: 0.8938 - val_acc: 0.6278
Epoch 261/2000
720/720 [==============================] - 0s 29us/step - loss: 0.7954 - acc: 0.6528 - val_loss: 0.9035 - val_acc: 0.6111
Epoch 262/2000
720/720 [==============================] - 0s 21us/step - loss: 0.7957 - acc: 0.6583 - val_loss: 0.8928 - val_acc: 0.6278
Epoch 263/2000
720/720 [==============================] - 0s 21us/step - loss: 0.7953 - acc: 0.6500 - val_loss: 0.9006 - val_acc: 0.6111
Epoch 264/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7944 - acc: 0.6611 - val_loss: 0.8942 - val_acc: 0.6167
Epoch 265/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7935 - acc: 0.6569 - val_loss: 0.8958 - val_acc: 0.6222
Epoch 266/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7931 - acc: 0.6583 - val_loss: 0.8977 - val_acc: 0.6278
Epoch 267/2000
720/720 [==============================] - 0s 18us/step - loss: 0.7930 - acc: 0.6583 - val_loss: 0.8929 - val_acc: 0.6278
Epoch 268/2000
720/720 [==============================] - 0s 35us/step - loss: 0.7932 - acc: 0.6569 - val_loss: 0.9000 - val_acc: 0.6167
Epoch 269/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7933 - acc: 0.6583 - val_loss: 0.8915 - val_acc: 0.6333
Epoch 270/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7933 - acc: 0.6528 - val_loss: 0.8996 - val_acc: 0.6222
Epoch 271/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7930 - acc: 0.6569 - val_loss: 0.8912 - val_acc: 0.6278
Epoch 272/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7925 - acc: 0.6569 - val_loss: 0.8977 - val_acc: 0.6222
Epoch 273/2000
720/720 [==============================] - 0s 29us/step - loss: 0.7920 - acc: 0.6556 - val_loss: 0.8917 - val_acc: 0.6222
Epoch 274/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7915 - acc: 0.6597 - val_loss: 0.8950 - val_acc: 0.6278
Epoch 275/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7911 - acc: 0.6569 - val_loss: 0.8923 - val_acc: 0.6278
Epoch 276/2000
720/720 [==============================] - 0s 17us/step - loss: 0.7907 - acc: 0.6583 - val_loss: 0.8929 - val_acc: 0.6333
Epoch 277/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7905 - acc: 0.6583 - val_loss: 0.8931 - val_acc: 0.6278
Epoch 278/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7902 - acc: 0.6611 - val_loss: 0.8913 - val_acc: 0.6278
Epoch 279/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7901 - acc: 0.6611 - val_loss: 0.8939 - val_acc: 0.6333
Epoch 280/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7899 - acc: 0.6611 - val_loss: 0.8896 - val_acc: 0.6278
Epoch 281/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7899 - acc: 0.6597 - val_loss: 0.8950 - val_acc: 0.6278
Epoch 282/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7899 - acc: 0.6639 - val_loss: 0.8881 - val_acc: 0.6278
Epoch 283/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7901 - acc: 0.6639 - val_loss: 0.8981 - val_acc: 0.6278
Epoch 284/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7907 - acc: 0.6639 - val_loss: 0.8867 - val_acc: 0.6333
Epoch 285/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7919 - acc: 0.6611 - val_loss: 0.9056 - val_acc: 0.6167
Epoch 286/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7943 - acc: 0.6653 - val_loss: 0.8874 - val_acc: 0.6333
Epoch 287/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7982 - acc: 0.6514 - val_loss: 0.9197 - val_acc: 0.6056
Epoch 288/2000
720/720 [==============================] - 0s 13us/step - loss: 0.8028 - acc: 0.6667 - val_loss: 0.8909 - val_acc: 0.6056
Epoch 289/2000
720/720 [==============================] - 0s 14us/step - loss: 0.8063 - acc: 0.6542 - val_loss: 0.9200 - val_acc: 0.6056
Epoch 290/2000
720/720 [==============================] - 0s 25us/step - loss: 0.8025 - acc: 0.6694 - val_loss: 0.8862 - val_acc: 0.6333
Epoch 291/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7942 - acc: 0.6514 - val_loss: 0.8929 - val_acc: 0.6333
Epoch 292/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7876 - acc: 0.6611 - val_loss: 0.8978 - val_acc: 0.6278
Epoch 293/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7891 - acc: 0.6653 - val_loss: 0.8860 - val_acc: 0.6278
Epoch 294/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7943 - acc: 0.6625 - val_loss: 0.9081 - val_acc: 0.6111
Epoch 295/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7947 - acc: 0.6667 - val_loss: 0.8847 - val_acc: 0.6333
Epoch 296/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7899 - acc: 0.6556 - val_loss: 0.8895 - val_acc: 0.6333
Epoch 297/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7863 - acc: 0.6597 - val_loss: 0.8968 - val_acc: 0.6222
Epoch 298/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7881 - acc: 0.6736 - val_loss: 0.8851 - val_acc: 0.6444
Epoch 299/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7910 - acc: 0.6625 - val_loss: 0.9000 - val_acc: 0.6167
Epoch 300/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7896 - acc: 0.6764 - val_loss: 0.8844 - val_acc: 0.6333
Epoch 301/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7862 - acc: 0.6722 - val_loss: 0.8849 - val_acc: 0.6278
Epoch 302/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7855 - acc: 0.6653 - val_loss: 0.8951 - val_acc: 0.6278
Epoch 303/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7874 - acc: 0.6722 - val_loss: 0.8824 - val_acc: 0.6389
Epoch 304/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7881 - acc: 0.6681 - val_loss: 0.8919 - val_acc: 0.6278
Epoch 305/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7860 - acc: 0.6722 - val_loss: 0.8843 - val_acc: 0.6333
Epoch 306/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7843 - acc: 0.6736 - val_loss: 0.8817 - val_acc: 0.6222
Epoch 307/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7848 - acc: 0.6736 - val_loss: 0.8921 - val_acc: 0.6278
Epoch 308/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7859 - acc: 0.6750 - val_loss: 0.8813 - val_acc: 0.6333
Epoch 309/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7856 - acc: 0.6708 - val_loss: 0.8888 - val_acc: 0.6222
Epoch 310/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7841 - acc: 0.6778 - val_loss: 0.8851 - val_acc: 0.6222
Epoch 311/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7832 - acc: 0.6778 - val_loss: 0.8821 - val_acc: 0.6278
Epoch 312/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7836 - acc: 0.6722 - val_loss: 0.8898 - val_acc: 0.6222
Epoch 313/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7841 - acc: 0.6736 - val_loss: 0.8807 - val_acc: 0.6222
Epoch 314/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7838 - acc: 0.6736 - val_loss: 0.8867 - val_acc: 0.6222
Epoch 315/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7828 - acc: 0.6778 - val_loss: 0.8829 - val_acc: 0.6222
Epoch 316/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7822 - acc: 0.6764 - val_loss: 0.8809 - val_acc: 0.6333
Epoch 317/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7822 - acc: 0.6722 - val_loss: 0.8861 - val_acc: 0.6222
Epoch 318/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7825 - acc: 0.6792 - val_loss: 0.8789 - val_acc: 0.6222
Epoch 319/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7824 - acc: 0.6736 - val_loss: 0.8854 - val_acc: 0.6167
Epoch 320/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7819 - acc: 0.6806 - val_loss: 0.8803 - val_acc: 0.6389
Epoch 321/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7813 - acc: 0.6736 - val_loss: 0.8816 - val_acc: 0.6333
Epoch 322/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7809 - acc: 0.6778 - val_loss: 0.8826 - val_acc: 0.6222
Epoch 323/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7808 - acc: 0.6764 - val_loss: 0.8786 - val_acc: 0.6333
Epoch 324/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7808 - acc: 0.6792 - val_loss: 0.8839 - val_acc: 0.6222
Epoch 325/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7808 - acc: 0.6806 - val_loss: 0.8778 - val_acc: 0.6333
Epoch 326/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7806 - acc: 0.6764 - val_loss: 0.8829 - val_acc: 0.6222
Epoch 327/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7802 - acc: 0.6833 - val_loss: 0.8780 - val_acc: 0.6389
Epoch 328/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7798 - acc: 0.6792 - val_loss: 0.8802 - val_acc: 0.6333
Epoch 329/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7794 - acc: 0.6792 - val_loss: 0.8788 - val_acc: 0.6333
Epoch 330/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7791 - acc: 0.6792 - val_loss: 0.8784 - val_acc: 0.6444
Epoch 331/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7789 - acc: 0.6833 - val_loss: 0.8801 - val_acc: 0.6278
Epoch 332/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7788 - acc: 0.6819 - val_loss: 0.8772 - val_acc: 0.6444
Epoch 333/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7787 - acc: 0.6819 - val_loss: 0.8813 - val_acc: 0.6278
Epoch 334/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7787 - acc: 0.6861 - val_loss: 0.8757 - val_acc: 0.6389
Epoch 335/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7788 - acc: 0.6833 - val_loss: 0.8832 - val_acc: 0.6278
Epoch 336/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7791 - acc: 0.6903 - val_loss: 0.8744 - val_acc: 0.6444
Epoch 337/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7797 - acc: 0.6778 - val_loss: 0.8871 - val_acc: 0.6278
Epoch 338/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7808 - acc: 0.6931 - val_loss: 0.8734 - val_acc: 0.6389
Epoch 339/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7824 - acc: 0.6736 - val_loss: 0.8938 - val_acc: 0.6111
Epoch 340/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7845 - acc: 0.6903 - val_loss: 0.8739 - val_acc: 0.6333
Epoch 341/2000
720/720 [==============================] - 0s 19us/step - loss: 0.7867 - acc: 0.6639 - val_loss: 0.8988 - val_acc: 0.6111
Epoch 342/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7874 - acc: 0.6847 - val_loss: 0.8734 - val_acc: 0.6389
Epoch 343/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7860 - acc: 0.6639 - val_loss: 0.8902 - val_acc: 0.6167
Epoch 344/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7817 - acc: 0.6847 - val_loss: 0.8724 - val_acc: 0.6500
Epoch 345/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7776 - acc: 0.6764 - val_loss: 0.8753 - val_acc: 0.6444
Epoch 346/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7759 - acc: 0.6861 - val_loss: 0.8809 - val_acc: 0.6389
Epoch 347/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7771 - acc: 0.6889 - val_loss: 0.8707 - val_acc: 0.6333
Epoch 348/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7794 - acc: 0.6694 - val_loss: 0.8870 - val_acc: 0.6222
Epoch 349/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7800 - acc: 0.6917 - val_loss: 0.8703 - val_acc: 0.6333
Epoch 350/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7786 - acc: 0.6694 - val_loss: 0.8796 - val_acc: 0.6333
Epoch 351/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7760 - acc: 0.6889 - val_loss: 0.8739 - val_acc: 0.6444
Epoch 352/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7746 - acc: 0.6889 - val_loss: 0.8714 - val_acc: 0.6389
Epoch 353/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7750 - acc: 0.6861 - val_loss: 0.8802 - val_acc: 0.6333
Epoch 354/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7762 - acc: 0.6903 - val_loss: 0.8685 - val_acc: 0.6389
Epoch 355/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7766 - acc: 0.6764 - val_loss: 0.8787 - val_acc: 0.6389
Epoch 356/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7757 - acc: 0.6917 - val_loss: 0.8689 - val_acc: 0.6500
Epoch 357/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7742 - acc: 0.6875 - val_loss: 0.8720 - val_acc: 0.6500
Epoch 358/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7733 - acc: 0.6889 - val_loss: 0.8735 - val_acc: 0.6444
Epoch 359/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7734 - acc: 0.6931 - val_loss: 0.8684 - val_acc: 0.6500
Epoch 360/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7739 - acc: 0.6861 - val_loss: 0.8773 - val_acc: 0.6444
Epoch 361/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7742 - acc: 0.6931 - val_loss: 0.8681 - val_acc: 0.6444
Epoch 362/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7740 - acc: 0.6806 - val_loss: 0.8759 - val_acc: 0.6444
Epoch 363/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7733 - acc: 0.6903 - val_loss: 0.8691 - val_acc: 0.6556
Epoch 364/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7724 - acc: 0.6806 - val_loss: 0.8713 - val_acc: 0.6556
Epoch 365/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7719 - acc: 0.6819 - val_loss: 0.8712 - val_acc: 0.6444
Epoch 366/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7718 - acc: 0.6944 - val_loss: 0.8681 - val_acc: 0.6500
Epoch 367/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7719 - acc: 0.6847 - val_loss: 0.8735 - val_acc: 0.6444
Epoch 368/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7719 - acc: 0.6972 - val_loss: 0.8672 - val_acc: 0.6444
Epoch 369/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7718 - acc: 0.6847 - val_loss: 0.8731 - val_acc: 0.6500
Epoch 370/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7715 - acc: 0.6944 - val_loss: 0.8667 - val_acc: 0.6500
Epoch 371/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7711 - acc: 0.6889 - val_loss: 0.8710 - val_acc: 0.6556
Epoch 372/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7707 - acc: 0.6903 - val_loss: 0.8673 - val_acc: 0.6556
Epoch 373/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7704 - acc: 0.6833 - val_loss: 0.8690 - val_acc: 0.6500
Epoch 374/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7702 - acc: 0.6819 - val_loss: 0.8679 - val_acc: 0.6556
Epoch 375/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7701 - acc: 0.6806 - val_loss: 0.8675 - val_acc: 0.6500
Epoch 376/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7702 - acc: 0.6861 - val_loss: 0.8683 - val_acc: 0.6389
Epoch 377/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7704 - acc: 0.6792 - val_loss: 0.8674 - val_acc: 0.6500
Epoch 378/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7704 - acc: 0.6806 - val_loss: 0.8684 - val_acc: 0.6444
Epoch 379/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7704 - acc: 0.6806 - val_loss: 0.8678 - val_acc: 0.6500
Epoch 380/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7700 - acc: 0.6806 - val_loss: 0.8665 - val_acc: 0.6444
Epoch 381/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7694 - acc: 0.6792 - val_loss: 0.8674 - val_acc: 0.6556
Epoch 382/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7687 - acc: 0.6861 - val_loss: 0.8643 - val_acc: 0.6556
Epoch 383/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7683 - acc: 0.6917 - val_loss: 0.8682 - val_acc: 0.6556
Epoch 384/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7683 - acc: 0.6917 - val_loss: 0.8632 - val_acc: 0.6556
Epoch 385/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7685 - acc: 0.6833 - val_loss: 0.8698 - val_acc: 0.6556
Epoch 386/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7688 - acc: 0.6958 - val_loss: 0.8619 - val_acc: 0.6556
Epoch 387/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7690 - acc: 0.6861 - val_loss: 0.8714 - val_acc: 0.6556
Epoch 388/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7693 - acc: 0.6972 - val_loss: 0.8607 - val_acc: 0.6500
Epoch 389/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7697 - acc: 0.6847 - val_loss: 0.8746 - val_acc: 0.6500
Epoch 390/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7705 - acc: 0.7000 - val_loss: 0.8611 - val_acc: 0.6333
Epoch 391/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7725 - acc: 0.6694 - val_loss: 0.8832 - val_acc: 0.6111
Epoch 392/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7759 - acc: 0.6694 - val_loss: 0.8656 - val_acc: 0.6222
Epoch 393/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7805 - acc: 0.6653 - val_loss: 0.8940 - val_acc: 0.5889
Epoch 394/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7830 - acc: 0.6681 - val_loss: 0.8652 - val_acc: 0.6333
Epoch 395/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7789 - acc: 0.6667 - val_loss: 0.8785 - val_acc: 0.6278
Epoch 396/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7709 - acc: 0.6972 - val_loss: 0.8639 - val_acc: 0.6611
Epoch 397/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7673 - acc: 0.6792 - val_loss: 0.8660 - val_acc: 0.6500
Epoch 398/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7695 - acc: 0.6792 - val_loss: 0.8749 - val_acc: 0.6278
Epoch 399/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7705 - acc: 0.6736 - val_loss: 0.8598 - val_acc: 0.6389
Epoch 400/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7687 - acc: 0.6736 - val_loss: 0.8710 - val_acc: 0.6500
Epoch 401/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7683 - acc: 0.7014 - val_loss: 0.8627 - val_acc: 0.6333
Epoch 402/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7690 - acc: 0.6694 - val_loss: 0.8656 - val_acc: 0.6444
Epoch 403/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7682 - acc: 0.6833 - val_loss: 0.8624 - val_acc: 0.6500
Epoch 404/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7648 - acc: 0.6875 - val_loss: 0.8603 - val_acc: 0.6611
Epoch 405/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7650 - acc: 0.6861 - val_loss: 0.8679 - val_acc: 0.6389
Epoch 406/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7677 - acc: 0.6847 - val_loss: 0.8609 - val_acc: 0.6278
Epoch 407/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7667 - acc: 0.6778 - val_loss: 0.8635 - val_acc: 0.6667
Epoch 408/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7644 - acc: 0.6944 - val_loss: 0.8579 - val_acc: 0.6667
Epoch 409/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7638 - acc: 0.6861 - val_loss: 0.8612 - val_acc: 0.6444
Epoch 410/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7647 - acc: 0.6819 - val_loss: 0.8626 - val_acc: 0.6500
Epoch 411/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7647 - acc: 0.6833 - val_loss: 0.8580 - val_acc: 0.6611
Epoch 412/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7634 - acc: 0.6861 - val_loss: 0.8630 - val_acc: 0.6611
Epoch 413/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7633 - acc: 0.6986 - val_loss: 0.8575 - val_acc: 0.6611
Epoch 414/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7639 - acc: 0.6778 - val_loss: 0.8620 - val_acc: 0.6500
Epoch 415/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7635 - acc: 0.6819 - val_loss: 0.8585 - val_acc: 0.6611
Epoch 416/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7622 - acc: 0.6847 - val_loss: 0.8588 - val_acc: 0.6667
Epoch 417/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7617 - acc: 0.6889 - val_loss: 0.8612 - val_acc: 0.6556
Epoch 418/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7622 - acc: 0.6889 - val_loss: 0.8573 - val_acc: 0.6556
Epoch 419/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7625 - acc: 0.6792 - val_loss: 0.8608 - val_acc: 0.6444
Epoch 420/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7621 - acc: 0.6931 - val_loss: 0.8552 - val_acc: 0.6667
Epoch 421/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7614 - acc: 0.6944 - val_loss: 0.8592 - val_acc: 0.6667
Epoch 422/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7610 - acc: 0.6972 - val_loss: 0.8564 - val_acc: 0.6611
Epoch 423/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7610 - acc: 0.6903 - val_loss: 0.8579 - val_acc: 0.6667
Epoch 424/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7608 - acc: 0.6875 - val_loss: 0.8572 - val_acc: 0.6556
Epoch 425/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7604 - acc: 0.6931 - val_loss: 0.8551 - val_acc: 0.6722
Epoch 426/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7601 - acc: 0.6903 - val_loss: 0.8580 - val_acc: 0.6611
Epoch 427/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7600 - acc: 0.6944 - val_loss: 0.8541 - val_acc: 0.6667
Epoch 428/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7601 - acc: 0.6917 - val_loss: 0.8590 - val_acc: 0.6667
Epoch 429/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7601 - acc: 0.6986 - val_loss: 0.8534 - val_acc: 0.6667
Epoch 430/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7598 - acc: 0.6917 - val_loss: 0.8579 - val_acc: 0.6611
Epoch 431/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7595 - acc: 0.7014 - val_loss: 0.8528 - val_acc: 0.6667
Epoch 432/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7592 - acc: 0.6931 - val_loss: 0.8569 - val_acc: 0.6556
Epoch 433/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7591 - acc: 0.6972 - val_loss: 0.8533 - val_acc: 0.6722
Epoch 434/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7591 - acc: 0.6833 - val_loss: 0.8578 - val_acc: 0.6444
Epoch 435/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7593 - acc: 0.6889 - val_loss: 0.8533 - val_acc: 0.6722
Epoch 436/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7597 - acc: 0.6806 - val_loss: 0.8602 - val_acc: 0.6444
Epoch 437/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7604 - acc: 0.6833 - val_loss: 0.8528 - val_acc: 0.6500
Epoch 438/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7615 - acc: 0.6750 - val_loss: 0.8669 - val_acc: 0.6167
Epoch 439/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7637 - acc: 0.6833 - val_loss: 0.8544 - val_acc: 0.6389
Epoch 440/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7668 - acc: 0.6694 - val_loss: 0.8789 - val_acc: 0.6056
Epoch 441/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7710 - acc: 0.6778 - val_loss: 0.8578 - val_acc: 0.6278
Epoch 442/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7739 - acc: 0.6681 - val_loss: 0.8826 - val_acc: 0.6167
Epoch 443/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7728 - acc: 0.6764 - val_loss: 0.8538 - val_acc: 0.6556
Epoch 444/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7668 - acc: 0.6750 - val_loss: 0.8629 - val_acc: 0.6611
Epoch 445/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7595 - acc: 0.6986 - val_loss: 0.8553 - val_acc: 0.6556
Epoch 446/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7569 - acc: 0.6917 - val_loss: 0.8525 - val_acc: 0.6500
Epoch 447/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7598 - acc: 0.6792 - val_loss: 0.8684 - val_acc: 0.6222
Epoch 448/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7634 - acc: 0.6847 - val_loss: 0.8503 - val_acc: 0.6444
Epoch 449/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7632 - acc: 0.6736 - val_loss: 0.8602 - val_acc: 0.6556
Epoch 450/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7594 - acc: 0.7069 - val_loss: 0.8491 - val_acc: 0.6611
Epoch 451/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7560 - acc: 0.6944 - val_loss: 0.8505 - val_acc: 0.6778
Epoch 452/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7564 - acc: 0.6847 - val_loss: 0.8617 - val_acc: 0.6389
Epoch 453/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7589 - acc: 0.6944 - val_loss: 0.8510 - val_acc: 0.6611
Epoch 454/2000
720/720 [==============================] - 0s 44us/step - loss: 0.7597 - acc: 0.6764 - val_loss: 0.8593 - val_acc: 0.6444
Epoch 455/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7576 - acc: 0.7014 - val_loss: 0.8489 - val_acc: 0.6722
Epoch 456/2000
720/720 [==============================] - 0s 42us/step - loss: 0.7550 - acc: 0.6958 - val_loss: 0.8490 - val_acc: 0.6722
Epoch 457/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7547 - acc: 0.6944 - val_loss: 0.8566 - val_acc: 0.6500
Epoch 458/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7563 - acc: 0.7000 - val_loss: 0.8489 - val_acc: 0.6667
Epoch 459/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7572 - acc: 0.6819 - val_loss: 0.8562 - val_acc: 0.6444
Epoch 460/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7562 - acc: 0.6944 - val_loss: 0.8477 - val_acc: 0.6778
Epoch 461/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7544 - acc: 0.6875 - val_loss: 0.8479 - val_acc: 0.6556
Epoch 462/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7536 - acc: 0.6972 - val_loss: 0.8524 - val_acc: 0.6556
Epoch 463/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7541 - acc: 0.7056 - val_loss: 0.8476 - val_acc: 0.6722
Epoch 464/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7547 - acc: 0.6875 - val_loss: 0.8550 - val_acc: 0.6556
Epoch 465/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7545 - acc: 0.7042 - val_loss: 0.8478 - val_acc: 0.6722
Epoch 466/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7536 - acc: 0.6875 - val_loss: 0.8491 - val_acc: 0.6556
Epoch 467/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7530 - acc: 0.6917 - val_loss: 0.8495 - val_acc: 0.6667
Epoch 468/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7530 - acc: 0.7000 - val_loss: 0.8461 - val_acc: 0.6556
Epoch 469/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7533 - acc: 0.6917 - val_loss: 0.8522 - val_acc: 0.6667
Epoch 470/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7534 - acc: 0.7042 - val_loss: 0.8459 - val_acc: 0.6611
Epoch 471/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7530 - acc: 0.6903 - val_loss: 0.8493 - val_acc: 0.6667
Epoch 472/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7523 - acc: 0.7028 - val_loss: 0.8461 - val_acc: 0.6556
Epoch 473/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7517 - acc: 0.6958 - val_loss: 0.8460 - val_acc: 0.6722
Epoch 474/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7515 - acc: 0.6931 - val_loss: 0.8492 - val_acc: 0.6556
Epoch 475/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7517 - acc: 0.6944 - val_loss: 0.8454 - val_acc: 0.6722
Epoch 476/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7520 - acc: 0.6875 - val_loss: 0.8508 - val_acc: 0.6556
Epoch 477/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7524 - acc: 0.6958 - val_loss: 0.8451 - val_acc: 0.6722
Epoch 478/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7528 - acc: 0.6833 - val_loss: 0.8510 - val_acc: 0.6444
Epoch 479/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7538 - acc: 0.6778 - val_loss: 0.8492 - val_acc: 0.6500
Epoch 480/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7560 - acc: 0.6792 - val_loss: 0.8566 - val_acc: 0.6056
Epoch 481/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7594 - acc: 0.6653 - val_loss: 0.8588 - val_acc: 0.6389
Epoch 482/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7645 - acc: 0.6806 - val_loss: 0.8616 - val_acc: 0.6000
Epoch 483/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7636 - acc: 0.6556 - val_loss: 0.8528 - val_acc: 0.6444
Epoch 484/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7591 - acc: 0.6792 - val_loss: 0.8504 - val_acc: 0.6444
Epoch 485/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7518 - acc: 0.6847 - val_loss: 0.8444 - val_acc: 0.6556
Epoch 486/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7504 - acc: 0.6903 - val_loss: 0.8528 - val_acc: 0.6611
Epoch 487/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7543 - acc: 0.6875 - val_loss: 0.8507 - val_acc: 0.6167
Epoch 488/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7548 - acc: 0.6681 - val_loss: 0.8478 - val_acc: 0.6778
Epoch 489/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7519 - acc: 0.6875 - val_loss: 0.8476 - val_acc: 0.6556
Epoch 490/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7493 - acc: 0.7014 - val_loss: 0.8435 - val_acc: 0.6444
Epoch 491/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7510 - acc: 0.6861 - val_loss: 0.8523 - val_acc: 0.6667
Epoch 492/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7534 - acc: 0.6917 - val_loss: 0.8432 - val_acc: 0.6389
Epoch 493/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7509 - acc: 0.6819 - val_loss: 0.8446 - val_acc: 0.6611
Epoch 494/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7482 - acc: 0.7028 - val_loss: 0.8444 - val_acc: 0.6722
Epoch 495/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7485 - acc: 0.6972 - val_loss: 0.8438 - val_acc: 0.6444
Epoch 496/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7500 - acc: 0.6833 - val_loss: 0.8470 - val_acc: 0.6667
Epoch 497/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7499 - acc: 0.6917 - val_loss: 0.8412 - val_acc: 0.6556
Epoch 498/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7478 - acc: 0.6944 - val_loss: 0.8427 - val_acc: 0.6556
Epoch 499/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7473 - acc: 0.6944 - val_loss: 0.8438 - val_acc: 0.6722
Epoch 500/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7484 - acc: 0.6917 - val_loss: 0.8441 - val_acc: 0.6444
Epoch 501/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7487 - acc: 0.6861 - val_loss: 0.8428 - val_acc: 0.6722
Epoch 502/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7478 - acc: 0.6903 - val_loss: 0.8434 - val_acc: 0.6556
Epoch 503/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7468 - acc: 0.7000 - val_loss: 0.8395 - val_acc: 0.6667
Epoch 504/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7470 - acc: 0.6931 - val_loss: 0.8458 - val_acc: 0.6611
Epoch 505/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7476 - acc: 0.7069 - val_loss: 0.8393 - val_acc: 0.6667
Epoch 506/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7473 - acc: 0.6889 - val_loss: 0.8442 - val_acc: 0.6611
Epoch 507/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7466 - acc: 0.7028 - val_loss: 0.8393 - val_acc: 0.6667
Epoch 508/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7462 - acc: 0.6958 - val_loss: 0.8431 - val_acc: 0.6500
Epoch 509/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7468 - acc: 0.6875 - val_loss: 0.8412 - val_acc: 0.6778
Epoch 510/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7479 - acc: 0.6833 - val_loss: 0.8466 - val_acc: 0.6389
Epoch 511/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7492 - acc: 0.6889 - val_loss: 0.8414 - val_acc: 0.6667
Epoch 512/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7510 - acc: 0.6819 - val_loss: 0.8567 - val_acc: 0.6167
Epoch 513/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7551 - acc: 0.6889 - val_loss: 0.8458 - val_acc: 0.6444
Epoch 514/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7605 - acc: 0.6778 - val_loss: 0.8731 - val_acc: 0.6111
Epoch 515/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7670 - acc: 0.6792 - val_loss: 0.8497 - val_acc: 0.6389
Epoch 516/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7663 - acc: 0.6694 - val_loss: 0.8628 - val_acc: 0.6111
Epoch 517/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7582 - acc: 0.6833 - val_loss: 0.8411 - val_acc: 0.6667
Epoch 518/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7472 - acc: 0.6847 - val_loss: 0.8408 - val_acc: 0.6667
Epoch 519/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7449 - acc: 0.6958 - val_loss: 0.8550 - val_acc: 0.6389
Epoch 520/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7509 - acc: 0.6986 - val_loss: 0.8429 - val_acc: 0.6667
Epoch 521/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7552 - acc: 0.6833 - val_loss: 0.8530 - val_acc: 0.6167
Epoch 522/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7528 - acc: 0.6903 - val_loss: 0.8375 - val_acc: 0.6722
Epoch 523/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7461 - acc: 0.6861 - val_loss: 0.8372 - val_acc: 0.6667
Epoch 524/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7440 - acc: 0.6972 - val_loss: 0.8491 - val_acc: 0.6500
Epoch 525/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7472 - acc: 0.7014 - val_loss: 0.8413 - val_acc: 0.6667
Epoch 526/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7495 - acc: 0.6806 - val_loss: 0.8479 - val_acc: 0.6278
Epoch 527/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7481 - acc: 0.6931 - val_loss: 0.8399 - val_acc: 0.6778
Epoch 528/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7449 - acc: 0.6903 - val_loss: 0.8371 - val_acc: 0.6667
Epoch 529/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7440 - acc: 0.6931 - val_loss: 0.8452 - val_acc: 0.6500
Epoch 530/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7449 - acc: 0.7083 - val_loss: 0.8382 - val_acc: 0.6722
Epoch 531/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7452 - acc: 0.6889 - val_loss: 0.8411 - val_acc: 0.6500
Epoch 532/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7445 - acc: 0.6889 - val_loss: 0.8392 - val_acc: 0.6722
Epoch 533/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7438 - acc: 0.6944 - val_loss: 0.8345 - val_acc: 0.6611
Epoch 534/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7432 - acc: 0.6917 - val_loss: 0.8394 - val_acc: 0.6556
Epoch 535/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7427 - acc: 0.7069 - val_loss: 0.8360 - val_acc: 0.6722
Epoch 536/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7424 - acc: 0.6972 - val_loss: 0.8384 - val_acc: 0.6444
Epoch 537/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7428 - acc: 0.6903 - val_loss: 0.8407 - val_acc: 0.6611
Epoch 538/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7431 - acc: 0.6944 - val_loss: 0.8359 - val_acc: 0.6500
Epoch 539/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7422 - acc: 0.6903 - val_loss: 0.8370 - val_acc: 0.6667
Epoch 540/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7410 - acc: 0.7014 - val_loss: 0.8348 - val_acc: 0.6667
Epoch 541/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7405 - acc: 0.7000 - val_loss: 0.8348 - val_acc: 0.6444
Epoch 542/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7411 - acc: 0.6917 - val_loss: 0.8381 - val_acc: 0.6611
Epoch 543/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7417 - acc: 0.7028 - val_loss: 0.8352 - val_acc: 0.6444
Epoch 544/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7414 - acc: 0.6917 - val_loss: 0.8350 - val_acc: 0.6722
Epoch 545/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7407 - acc: 0.6972 - val_loss: 0.8352 - val_acc: 0.6556
Epoch 546/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7403 - acc: 0.6972 - val_loss: 0.8325 - val_acc: 0.6667
Epoch 547/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7402 - acc: 0.6986 - val_loss: 0.8370 - val_acc: 0.6556
Epoch 548/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7401 - acc: 0.7069 - val_loss: 0.8331 - val_acc: 0.6667
Epoch 549/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7396 - acc: 0.6958 - val_loss: 0.8348 - val_acc: 0.6611
Epoch 550/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7391 - acc: 0.7028 - val_loss: 0.8331 - val_acc: 0.6667
Epoch 551/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7388 - acc: 0.7000 - val_loss: 0.8318 - val_acc: 0.6611
Epoch 552/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7388 - acc: 0.6986 - val_loss: 0.8338 - val_acc: 0.6611
Epoch 553/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7387 - acc: 0.7028 - val_loss: 0.8318 - val_acc: 0.6611
Epoch 554/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7385 - acc: 0.6986 - val_loss: 0.8330 - val_acc: 0.6667
Epoch 555/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7382 - acc: 0.7014 - val_loss: 0.8325 - val_acc: 0.6667
Epoch 556/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7380 - acc: 0.7014 - val_loss: 0.8312 - val_acc: 0.6722
Epoch 557/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7379 - acc: 0.6958 - val_loss: 0.8336 - val_acc: 0.6556
Epoch 558/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7380 - acc: 0.7028 - val_loss: 0.8316 - val_acc: 0.6667
Epoch 559/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7381 - acc: 0.6958 - val_loss: 0.8351 - val_acc: 0.6556
Epoch 560/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7387 - acc: 0.6972 - val_loss: 0.8340 - val_acc: 0.6722
Epoch 561/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7403 - acc: 0.6889 - val_loss: 0.8409 - val_acc: 0.6333
Epoch 562/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7446 - acc: 0.6792 - val_loss: 0.8461 - val_acc: 0.6500
Epoch 563/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7538 - acc: 0.6819 - val_loss: 0.8690 - val_acc: 0.6056
Epoch 564/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7698 - acc: 0.6556 - val_loss: 0.8690 - val_acc: 0.6222
Epoch 565/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7794 - acc: 0.6681 - val_loss: 0.8753 - val_acc: 0.5889
Epoch 566/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7704 - acc: 0.6639 - val_loss: 0.8363 - val_acc: 0.6667
Epoch 567/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7445 - acc: 0.6792 - val_loss: 0.8403 - val_acc: 0.6722
Epoch 568/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7434 - acc: 0.6972 - val_loss: 0.8552 - val_acc: 0.6056
Epoch 569/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7562 - acc: 0.6625 - val_loss: 0.8428 - val_acc: 0.6389
Epoch 570/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7491 - acc: 0.6861 - val_loss: 0.8448 - val_acc: 0.6611
Epoch 571/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7404 - acc: 0.7111 - val_loss: 0.8416 - val_acc: 0.6056
Epoch 572/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7452 - acc: 0.6694 - val_loss: 0.8399 - val_acc: 0.6722
Epoch 573/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7459 - acc: 0.6917 - val_loss: 0.8374 - val_acc: 0.6556
Epoch 574/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7392 - acc: 0.7000 - val_loss: 0.8355 - val_acc: 0.6389
Epoch 575/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7429 - acc: 0.6833 - val_loss: 0.8474 - val_acc: 0.6778
Epoch 576/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7461 - acc: 0.6958 - val_loss: 0.8364 - val_acc: 0.6444
Epoch 577/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7374 - acc: 0.6889 - val_loss: 0.8337 - val_acc: 0.6444
Epoch 578/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7401 - acc: 0.6819 - val_loss: 0.8449 - val_acc: 0.6667
Epoch 579/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7459 - acc: 0.6958 - val_loss: 0.8295 - val_acc: 0.6500
Epoch 580/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7373 - acc: 0.6903 - val_loss: 0.8320 - val_acc: 0.6444
Epoch 581/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7374 - acc: 0.6903 - val_loss: 0.8432 - val_acc: 0.6667
Epoch 582/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7424 - acc: 0.6889 - val_loss: 0.8307 - val_acc: 0.6611
Epoch 583/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7373 - acc: 0.6931 - val_loss: 0.8310 - val_acc: 0.6556
Epoch 584/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7367 - acc: 0.6903 - val_loss: 0.8327 - val_acc: 0.6722
Epoch 585/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7391 - acc: 0.7000 - val_loss: 0.8275 - val_acc: 0.6500
Epoch 586/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7357 - acc: 0.6931 - val_loss: 0.8324 - val_acc: 0.6500
Epoch 587/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7354 - acc: 0.6972 - val_loss: 0.8352 - val_acc: 0.6778
Epoch 588/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7376 - acc: 0.6944 - val_loss: 0.8317 - val_acc: 0.6500
Epoch 589/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7353 - acc: 0.6903 - val_loss: 0.8280 - val_acc: 0.6667
Epoch 590/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7339 - acc: 0.6986 - val_loss: 0.8301 - val_acc: 0.6722
Epoch 591/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7357 - acc: 0.7056 - val_loss: 0.8304 - val_acc: 0.6556
Epoch 592/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7353 - acc: 0.6917 - val_loss: 0.8288 - val_acc: 0.6667
Epoch 593/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7339 - acc: 0.6986 - val_loss: 0.8326 - val_acc: 0.6611
Epoch 594/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7343 - acc: 0.7056 - val_loss: 0.8273 - val_acc: 0.6611
Epoch 595/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7339 - acc: 0.6944 - val_loss: 0.8262 - val_acc: 0.6722
Epoch 596/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7330 - acc: 0.7069 - val_loss: 0.8291 - val_acc: 0.6611
Epoch 597/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7333 - acc: 0.7097 - val_loss: 0.8265 - val_acc: 0.6667
Epoch 598/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7337 - acc: 0.7028 - val_loss: 0.8305 - val_acc: 0.6611
Epoch 599/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7329 - acc: 0.7083 - val_loss: 0.8271 - val_acc: 0.6667
Epoch 600/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7321 - acc: 0.6986 - val_loss: 0.8252 - val_acc: 0.6556
Epoch 601/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7324 - acc: 0.6972 - val_loss: 0.8276 - val_acc: 0.6611
Epoch 602/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7325 - acc: 0.7083 - val_loss: 0.8248 - val_acc: 0.6667
Epoch 603/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7319 - acc: 0.6972 - val_loss: 0.8268 - val_acc: 0.6556
Epoch 604/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7318 - acc: 0.7014 - val_loss: 0.8274 - val_acc: 0.6722
Epoch 605/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7320 - acc: 0.7014 - val_loss: 0.8259 - val_acc: 0.6611
Epoch 606/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7318 - acc: 0.6972 - val_loss: 0.8251 - val_acc: 0.6722
Epoch 607/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7312 - acc: 0.7028 - val_loss: 0.8265 - val_acc: 0.6611
Epoch 608/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7311 - acc: 0.7056 - val_loss: 0.8251 - val_acc: 0.6667
Epoch 609/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7311 - acc: 0.6986 - val_loss: 0.8274 - val_acc: 0.6667
Epoch 610/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7308 - acc: 0.7069 - val_loss: 0.8257 - val_acc: 0.6667
Epoch 611/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7304 - acc: 0.7000 - val_loss: 0.8248 - val_acc: 0.6667
Epoch 612/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7304 - acc: 0.7000 - val_loss: 0.8263 - val_acc: 0.6667
Epoch 613/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7304 - acc: 0.7069 - val_loss: 0.8245 - val_acc: 0.6722
Epoch 614/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7302 - acc: 0.6986 - val_loss: 0.8259 - val_acc: 0.6667
Epoch 615/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7299 - acc: 0.7028 - val_loss: 0.8254 - val_acc: 0.6722
Epoch 616/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7299 - acc: 0.7042 - val_loss: 0.8250 - val_acc: 0.6667
Epoch 617/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7299 - acc: 0.7014 - val_loss: 0.8252 - val_acc: 0.6722
Epoch 618/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7299 - acc: 0.7028 - val_loss: 0.8260 - val_acc: 0.6611
Epoch 619/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7299 - acc: 0.7028 - val_loss: 0.8248 - val_acc: 0.6667
Epoch 620/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7302 - acc: 0.7000 - val_loss: 0.8288 - val_acc: 0.6611
Epoch 621/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7312 - acc: 0.7069 - val_loss: 0.8260 - val_acc: 0.6611
Epoch 622/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7329 - acc: 0.6958 - val_loss: 0.8348 - val_acc: 0.6389
Epoch 623/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7366 - acc: 0.6972 - val_loss: 0.8340 - val_acc: 0.6611
Epoch 624/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7418 - acc: 0.6861 - val_loss: 0.8512 - val_acc: 0.6111
Epoch 625/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7515 - acc: 0.6778 - val_loss: 0.8452 - val_acc: 0.6278
Epoch 626/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7538 - acc: 0.6750 - val_loss: 0.8525 - val_acc: 0.6167
Epoch 627/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7516 - acc: 0.6778 - val_loss: 0.8301 - val_acc: 0.6667
Epoch 628/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7365 - acc: 0.6875 - val_loss: 0.8268 - val_acc: 0.6667
Epoch 629/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7289 - acc: 0.7056 - val_loss: 0.8333 - val_acc: 0.6389
Epoch 630/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7339 - acc: 0.7000 - val_loss: 0.8356 - val_acc: 0.6667
Epoch 631/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7406 - acc: 0.6861 - val_loss: 0.8415 - val_acc: 0.6222
Epoch 632/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7407 - acc: 0.6931 - val_loss: 0.8246 - val_acc: 0.6611
Epoch 633/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7318 - acc: 0.6958 - val_loss: 0.8237 - val_acc: 0.6722
Epoch 634/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7281 - acc: 0.7069 - val_loss: 0.8310 - val_acc: 0.6444
Epoch 635/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7325 - acc: 0.6958 - val_loss: 0.8323 - val_acc: 0.6556
Epoch 636/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7365 - acc: 0.6847 - val_loss: 0.8362 - val_acc: 0.6444
Epoch 637/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7351 - acc: 0.7014 - val_loss: 0.8231 - val_acc: 0.6611
Epoch 638/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7291 - acc: 0.6972 - val_loss: 0.8220 - val_acc: 0.6722
Epoch 639/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7278 - acc: 0.6986 - val_loss: 0.8290 - val_acc: 0.6500
Epoch 640/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7313 - acc: 0.6986 - val_loss: 0.8276 - val_acc: 0.6667
Epoch 641/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7323 - acc: 0.6917 - val_loss: 0.8281 - val_acc: 0.6556
Epoch 642/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7293 - acc: 0.7056 - val_loss: 0.8218 - val_acc: 0.6722
Epoch 643/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7266 - acc: 0.6986 - val_loss: 0.8206 - val_acc: 0.6667
Epoch 644/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7279 - acc: 0.6972 - val_loss: 0.8258 - val_acc: 0.6611
Epoch 645/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7298 - acc: 0.7000 - val_loss: 0.8242 - val_acc: 0.6722
Epoch 646/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7287 - acc: 0.6972 - val_loss: 0.8242 - val_acc: 0.6611
Epoch 647/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7267 - acc: 0.7042 - val_loss: 0.8242 - val_acc: 0.6611
Epoch 648/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7260 - acc: 0.7069 - val_loss: 0.8213 - val_acc: 0.6667
Epoch 649/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7269 - acc: 0.7000 - val_loss: 0.8238 - val_acc: 0.6611
Epoch 650/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7275 - acc: 0.7069 - val_loss: 0.8231 - val_acc: 0.6722
Epoch 651/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7269 - acc: 0.7028 - val_loss: 0.8220 - val_acc: 0.6611
Epoch 652/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7262 - acc: 0.6972 - val_loss: 0.8246 - val_acc: 0.6611
Epoch 653/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7259 - acc: 0.7069 - val_loss: 0.8196 - val_acc: 0.6722
Epoch 654/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7256 - acc: 0.7042 - val_loss: 0.8211 - val_acc: 0.6667
Epoch 655/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7252 - acc: 0.7083 - val_loss: 0.8209 - val_acc: 0.6722
Epoch 656/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7252 - acc: 0.7056 - val_loss: 0.8201 - val_acc: 0.6667
Epoch 657/2000
720/720 [==============================] - 0s 32us/step - loss: 0.7255 - acc: 0.6972 - val_loss: 0.8243 - val_acc: 0.6722
Epoch 658/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7259 - acc: 0.7083 - val_loss: 0.8192 - val_acc: 0.6556
Epoch 659/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7255 - acc: 0.6944 - val_loss: 0.8217 - val_acc: 0.6722
Epoch 660/2000
720/720 [==============================] - 0s 33us/step - loss: 0.7250 - acc: 0.7097 - val_loss: 0.8191 - val_acc: 0.6667
Epoch 661/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7244 - acc: 0.7028 - val_loss: 0.8192 - val_acc: 0.6722
Epoch 662/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7242 - acc: 0.6986 - val_loss: 0.8205 - val_acc: 0.6667
Epoch 663/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7241 - acc: 0.7111 - val_loss: 0.8184 - val_acc: 0.6778
Epoch 664/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7238 - acc: 0.7056 - val_loss: 0.8200 - val_acc: 0.6722
Epoch 665/2000
720/720 [==============================] - 0s 33us/step - loss: 0.7235 - acc: 0.7069 - val_loss: 0.8193 - val_acc: 0.6778
Epoch 666/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7232 - acc: 0.7069 - val_loss: 0.8193 - val_acc: 0.6722
Epoch 667/2000
720/720 [==============================] - 0s 19us/step - loss: 0.7232 - acc: 0.7042 - val_loss: 0.8200 - val_acc: 0.6722
Epoch 668/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7233 - acc: 0.7069 - val_loss: 0.8189 - val_acc: 0.6722
Epoch 669/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7233 - acc: 0.7028 - val_loss: 0.8196 - val_acc: 0.6611
Epoch 670/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7233 - acc: 0.7056 - val_loss: 0.8207 - val_acc: 0.6722
Epoch 671/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7236 - acc: 0.7042 - val_loss: 0.8193 - val_acc: 0.6611
Epoch 672/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7244 - acc: 0.6958 - val_loss: 0.8244 - val_acc: 0.6722
Epoch 673/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7262 - acc: 0.7028 - val_loss: 0.8227 - val_acc: 0.6333
Epoch 674/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7295 - acc: 0.6875 - val_loss: 0.8354 - val_acc: 0.6722
Epoch 675/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7356 - acc: 0.6972 - val_loss: 0.8389 - val_acc: 0.6111
Epoch 676/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7443 - acc: 0.6736 - val_loss: 0.8490 - val_acc: 0.6333
Epoch 677/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7498 - acc: 0.6833 - val_loss: 0.8467 - val_acc: 0.6111
Epoch 678/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7492 - acc: 0.6736 - val_loss: 0.8284 - val_acc: 0.6667
Epoch 679/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7328 - acc: 0.6917 - val_loss: 0.8225 - val_acc: 0.6556
Epoch 680/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7235 - acc: 0.7056 - val_loss: 0.8243 - val_acc: 0.6444
Epoch 681/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7277 - acc: 0.6944 - val_loss: 0.8359 - val_acc: 0.6722
Epoch 682/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7344 - acc: 0.6917 - val_loss: 0.8369 - val_acc: 0.6222
Epoch 683/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7337 - acc: 0.6972 - val_loss: 0.8211 - val_acc: 0.6611
Epoch 684/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7264 - acc: 0.6958 - val_loss: 0.8235 - val_acc: 0.6722
Epoch 685/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7251 - acc: 0.7111 - val_loss: 0.8228 - val_acc: 0.6333
Epoch 686/2000
720/720 [==============================] - 0s 33us/step - loss: 0.7269 - acc: 0.6931 - val_loss: 0.8274 - val_acc: 0.6667
Epoch 687/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7282 - acc: 0.6917 - val_loss: 0.8336 - val_acc: 0.6556
Epoch 688/2000
720/720 [==============================] - 0s 21us/step - loss: 0.7287 - acc: 0.7111 - val_loss: 0.8187 - val_acc: 0.6611
Epoch 689/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7260 - acc: 0.7014 - val_loss: 0.8194 - val_acc: 0.6722
Epoch 690/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7233 - acc: 0.7097 - val_loss: 0.8195 - val_acc: 0.6611
Epoch 691/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7229 - acc: 0.7083 - val_loss: 0.8222 - val_acc: 0.6611
Epoch 692/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7256 - acc: 0.6944 - val_loss: 0.8303 - val_acc: 0.6556
Epoch 693/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7263 - acc: 0.7153 - val_loss: 0.8154 - val_acc: 0.6722
Epoch 694/2000
720/720 [==============================] - 0s 35us/step - loss: 0.7223 - acc: 0.7056 - val_loss: 0.8136 - val_acc: 0.6722
Epoch 695/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7205 - acc: 0.7083 - val_loss: 0.8203 - val_acc: 0.6667
Epoch 696/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7226 - acc: 0.7167 - val_loss: 0.8183 - val_acc: 0.6667
Epoch 697/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7236 - acc: 0.6986 - val_loss: 0.8220 - val_acc: 0.6667
Epoch 698/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7215 - acc: 0.7139 - val_loss: 0.8167 - val_acc: 0.6722
Epoch 699/2000
720/720 [==============================] - 0s 17us/step - loss: 0.7198 - acc: 0.7069 - val_loss: 0.8143 - val_acc: 0.6722
Epoch 700/2000
720/720 [==============================] - 0s 31us/step - loss: 0.7206 - acc: 0.7056 - val_loss: 0.8212 - val_acc: 0.6667
Epoch 701/2000
720/720 [==============================] - 0s 18us/step - loss: 0.7215 - acc: 0.7139 - val_loss: 0.8168 - val_acc: 0.6722
Epoch 702/2000
720/720 [==============================] - 0s 19us/step - loss: 0.7203 - acc: 0.7014 - val_loss: 0.8168 - val_acc: 0.6611
Epoch 703/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7196 - acc: 0.7056 - val_loss: 0.8191 - val_acc: 0.6722
Epoch 704/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7201 - acc: 0.7097 - val_loss: 0.8142 - val_acc: 0.6722
Epoch 705/2000
720/720 [==============================] - 0s 57us/step - loss: 0.7200 - acc: 0.7042 - val_loss: 0.8173 - val_acc: 0.6778
Epoch 706/2000
720/720 [==============================] - 0s 39us/step - loss: 0.7191 - acc: 0.7097 - val_loss: 0.8157 - val_acc: 0.6778
Epoch 707/2000
720/720 [==============================] - 0s 15us/step - loss: 0.7186 - acc: 0.7069 - val_loss: 0.8139 - val_acc: 0.6778
Epoch 708/2000
720/720 [==============================] - 0s 17us/step - loss: 0.7191 - acc: 0.7028 - val_loss: 0.8179 - val_acc: 0.6722
Epoch 709/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7194 - acc: 0.7083 - val_loss: 0.8139 - val_acc: 0.6667
Epoch 710/2000
720/720 [==============================] - 0s 40us/step - loss: 0.7189 - acc: 0.7028 - val_loss: 0.8158 - val_acc: 0.6778
Epoch 711/2000
720/720 [==============================] - 0s 42us/step - loss: 0.7184 - acc: 0.7042 - val_loss: 0.8160 - val_acc: 0.6667
Epoch 712/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7184 - acc: 0.7083 - val_loss: 0.8132 - val_acc: 0.6722
Epoch 713/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7185 - acc: 0.7042 - val_loss: 0.8151 - val_acc: 0.6722
Epoch 714/2000
720/720 [==============================] - 0s 38us/step - loss: 0.7181 - acc: 0.7083 - val_loss: 0.8141 - val_acc: 0.6778
Epoch 715/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7176 - acc: 0.7083 - val_loss: 0.8144 - val_acc: 0.6778
Epoch 716/2000
720/720 [==============================] - 0s 35us/step - loss: 0.7174 - acc: 0.7069 - val_loss: 0.8163 - val_acc: 0.6778
Epoch 717/2000
720/720 [==============================] - 0s 29us/step - loss: 0.7175 - acc: 0.7097 - val_loss: 0.8129 - val_acc: 0.6778
Epoch 718/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7174 - acc: 0.7083 - val_loss: 0.8145 - val_acc: 0.6778
Epoch 719/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7170 - acc: 0.7139 - val_loss: 0.8143 - val_acc: 0.6778
Epoch 720/2000
720/720 [==============================] - 0s 19us/step - loss: 0.7168 - acc: 0.7083 - val_loss: 0.8141 - val_acc: 0.6778
Epoch 721/2000
720/720 [==============================] - 0s 36us/step - loss: 0.7168 - acc: 0.7056 - val_loss: 0.8156 - val_acc: 0.6778
Epoch 722/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7168 - acc: 0.7097 - val_loss: 0.8125 - val_acc: 0.6778
Epoch 723/2000
720/720 [==============================] - 0s 38us/step - loss: 0.7166 - acc: 0.7097 - val_loss: 0.8137 - val_acc: 0.6778
Epoch 724/2000
720/720 [==============================] - 0s 44us/step - loss: 0.7163 - acc: 0.7125 - val_loss: 0.8137 - val_acc: 0.6778
Epoch 725/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7162 - acc: 0.7069 - val_loss: 0.8134 - val_acc: 0.6778
Epoch 726/2000
720/720 [==============================] - 0s 21us/step - loss: 0.7161 - acc: 0.7083 - val_loss: 0.8145 - val_acc: 0.6778
Epoch 727/2000
720/720 [==============================] - 0s 36us/step - loss: 0.7162 - acc: 0.7069 - val_loss: 0.8127 - val_acc: 0.6778
Epoch 728/2000
720/720 [==============================] - 0s 39us/step - loss: 0.7162 - acc: 0.7056 - val_loss: 0.8139 - val_acc: 0.6667
Epoch 729/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7165 - acc: 0.7069 - val_loss: 0.8162 - val_acc: 0.6722
Epoch 730/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7178 - acc: 0.7028 - val_loss: 0.8184 - val_acc: 0.6500
Epoch 731/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7220 - acc: 0.6972 - val_loss: 0.8326 - val_acc: 0.6611
Epoch 732/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7325 - acc: 0.6917 - val_loss: 0.8552 - val_acc: 0.6056
Epoch 733/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7598 - acc: 0.6708 - val_loss: 0.8792 - val_acc: 0.6111
Epoch 734/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7794 - acc: 0.6681 - val_loss: 0.8823 - val_acc: 0.5944
Epoch 735/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7815 - acc: 0.6681 - val_loss: 0.8239 - val_acc: 0.6611
Epoch 736/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7263 - acc: 0.6917 - val_loss: 0.8336 - val_acc: 0.6500
Epoch 737/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7353 - acc: 0.6944 - val_loss: 0.8640 - val_acc: 0.5944
Epoch 738/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7638 - acc: 0.6653 - val_loss: 0.8284 - val_acc: 0.6667
Epoch 739/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7249 - acc: 0.6917 - val_loss: 0.8379 - val_acc: 0.6556
Epoch 740/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7315 - acc: 0.6917 - val_loss: 0.8467 - val_acc: 0.6056
Epoch 741/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7454 - acc: 0.6806 - val_loss: 0.8141 - val_acc: 0.6556
Epoch 742/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7200 - acc: 0.7083 - val_loss: 0.8369 - val_acc: 0.6611
Epoch 743/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7350 - acc: 0.7042 - val_loss: 0.8453 - val_acc: 0.6056
Epoch 744/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7383 - acc: 0.6889 - val_loss: 0.8253 - val_acc: 0.6556
Epoch 745/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7235 - acc: 0.6917 - val_loss: 0.8438 - val_acc: 0.6778
Epoch 746/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7388 - acc: 0.7014 - val_loss: 0.8239 - val_acc: 0.6389
Epoch 747/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7247 - acc: 0.6931 - val_loss: 0.8237 - val_acc: 0.6278
Epoch 748/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7307 - acc: 0.6667 - val_loss: 0.8480 - val_acc: 0.6722
Epoch 749/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7387 - acc: 0.7042 - val_loss: 0.8223 - val_acc: 0.6611
Epoch 750/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7169 - acc: 0.7111 - val_loss: 0.8304 - val_acc: 0.6000
Epoch 751/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7399 - acc: 0.6583 - val_loss: 0.8347 - val_acc: 0.6611
Epoch 752/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7315 - acc: 0.7042 - val_loss: 0.8197 - val_acc: 0.6722
Epoch 753/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7238 - acc: 0.6986 - val_loss: 0.8243 - val_acc: 0.6000
Epoch 754/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7352 - acc: 0.6611 - val_loss: 0.8303 - val_acc: 0.6500
Epoch 755/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7230 - acc: 0.7181 - val_loss: 0.8373 - val_acc: 0.6611
Epoch 756/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7322 - acc: 0.6889 - val_loss: 0.8165 - val_acc: 0.6444
Epoch 757/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7193 - acc: 0.6917 - val_loss: 0.8213 - val_acc: 0.6278
Epoch 758/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7230 - acc: 0.6917 - val_loss: 0.8266 - val_acc: 0.6778
Epoch 759/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7245 - acc: 0.6931 - val_loss: 0.8200 - val_acc: 0.6722
Epoch 760/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7157 - acc: 0.7056 - val_loss: 0.8223 - val_acc: 0.6278
Epoch 761/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7231 - acc: 0.6875 - val_loss: 0.8147 - val_acc: 0.6722
Epoch 762/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7158 - acc: 0.7042 - val_loss: 0.8214 - val_acc: 0.6722
Epoch 763/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7193 - acc: 0.7069 - val_loss: 0.8141 - val_acc: 0.6611
Epoch 764/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7165 - acc: 0.7028 - val_loss: 0.8131 - val_acc: 0.6611
Epoch 765/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7177 - acc: 0.6986 - val_loss: 0.8216 - val_acc: 0.6722
Epoch 766/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7174 - acc: 0.7153 - val_loss: 0.8153 - val_acc: 0.6722
Epoch 767/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7144 - acc: 0.7139 - val_loss: 0.8105 - val_acc: 0.6500
Epoch 768/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7187 - acc: 0.6931 - val_loss: 0.8142 - val_acc: 0.6667
Epoch 769/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7140 - acc: 0.7125 - val_loss: 0.8173 - val_acc: 0.6722
Epoch 770/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7153 - acc: 0.7139 - val_loss: 0.8090 - val_acc: 0.6667
Epoch 771/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7153 - acc: 0.7014 - val_loss: 0.8094 - val_acc: 0.6667
Epoch 772/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7135 - acc: 0.7083 - val_loss: 0.8140 - val_acc: 0.6722
Epoch 773/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7149 - acc: 0.7111 - val_loss: 0.8083 - val_acc: 0.6778
Epoch 774/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7125 - acc: 0.7056 - val_loss: 0.8101 - val_acc: 0.6611
Epoch 775/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7139 - acc: 0.7000 - val_loss: 0.8144 - val_acc: 0.6722
Epoch 776/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7133 - acc: 0.7111 - val_loss: 0.8115 - val_acc: 0.6778
Epoch 777/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7121 - acc: 0.7125 - val_loss: 0.8084 - val_acc: 0.6722
Epoch 778/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7133 - acc: 0.7000 - val_loss: 0.8112 - val_acc: 0.6778
Epoch 779/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7120 - acc: 0.7083 - val_loss: 0.8142 - val_acc: 0.6778
Epoch 780/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7121 - acc: 0.7111 - val_loss: 0.8096 - val_acc: 0.6722
Epoch 781/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7120 - acc: 0.7042 - val_loss: 0.8095 - val_acc: 0.6778
Epoch 782/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7112 - acc: 0.7111 - val_loss: 0.8122 - val_acc: 0.6778
Epoch 783/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7119 - acc: 0.7125 - val_loss: 0.8078 - val_acc: 0.6778
Epoch 784/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7111 - acc: 0.7125 - val_loss: 0.8089 - val_acc: 0.6778
Epoch 785/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7108 - acc: 0.7111 - val_loss: 0.8130 - val_acc: 0.6778
Epoch 786/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7112 - acc: 0.7097 - val_loss: 0.8090 - val_acc: 0.6778
Epoch 787/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7105 - acc: 0.7125 - val_loss: 0.8078 - val_acc: 0.6778
Epoch 788/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7106 - acc: 0.7083 - val_loss: 0.8107 - val_acc: 0.6778
Epoch 789/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7105 - acc: 0.7097 - val_loss: 0.8090 - val_acc: 0.6778
Epoch 790/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7100 - acc: 0.7125 - val_loss: 0.8081 - val_acc: 0.6778
Epoch 791/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7102 - acc: 0.7069 - val_loss: 0.8100 - val_acc: 0.6778
Epoch 792/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7100 - acc: 0.7097 - val_loss: 0.8085 - val_acc: 0.6778
Epoch 793/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7096 - acc: 0.7125 - val_loss: 0.8071 - val_acc: 0.6778
Epoch 794/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7097 - acc: 0.7097 - val_loss: 0.8098 - val_acc: 0.6778
Epoch 795/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7095 - acc: 0.7111 - val_loss: 0.8093 - val_acc: 0.6778
Epoch 796/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7093 - acc: 0.7125 - val_loss: 0.8075 - val_acc: 0.6778
Epoch 797/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7093 - acc: 0.7111 - val_loss: 0.8096 - val_acc: 0.6778
Epoch 798/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7091 - acc: 0.7153 - val_loss: 0.8091 - val_acc: 0.6778
Epoch 799/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7089 - acc: 0.7153 - val_loss: 0.8078 - val_acc: 0.6778
Epoch 800/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7089 - acc: 0.7139 - val_loss: 0.8094 - val_acc: 0.6778
Epoch 801/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7087 - acc: 0.7153 - val_loss: 0.8084 - val_acc: 0.6778
Epoch 802/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7085 - acc: 0.7167 - val_loss: 0.8073 - val_acc: 0.6778
Epoch 803/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7085 - acc: 0.7125 - val_loss: 0.8091 - val_acc: 0.6778
Epoch 804/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7083 - acc: 0.7139 - val_loss: 0.8084 - val_acc: 0.6778
Epoch 805/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7081 - acc: 0.7139 - val_loss: 0.8071 - val_acc: 0.6778
Epoch 806/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7081 - acc: 0.7097 - val_loss: 0.8083 - val_acc: 0.6778
Epoch 807/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7080 - acc: 0.7153 - val_loss: 0.8076 - val_acc: 0.6778
Epoch 808/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7078 - acc: 0.7139 - val_loss: 0.8072 - val_acc: 0.6778
Epoch 809/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7077 - acc: 0.7111 - val_loss: 0.8085 - val_acc: 0.6778
Epoch 810/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7076 - acc: 0.7153 - val_loss: 0.8072 - val_acc: 0.6778
Epoch 811/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7075 - acc: 0.7139 - val_loss: 0.8067 - val_acc: 0.6778
Epoch 812/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7074 - acc: 0.7125 - val_loss: 0.8080 - val_acc: 0.6778
Epoch 813/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7073 - acc: 0.7153 - val_loss: 0.8072 - val_acc: 0.6778
Epoch 814/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7071 - acc: 0.7111 - val_loss: 0.8072 - val_acc: 0.6778
Epoch 815/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7070 - acc: 0.7139 - val_loss: 0.8078 - val_acc: 0.6778
Epoch 816/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7069 - acc: 0.7153 - val_loss: 0.8067 - val_acc: 0.6778
Epoch 817/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7068 - acc: 0.7125 - val_loss: 0.8071 - val_acc: 0.6778
Epoch 818/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7066 - acc: 0.7125 - val_loss: 0.8077 - val_acc: 0.6778
Epoch 819/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7066 - acc: 0.7139 - val_loss: 0.8066 - val_acc: 0.6778
Epoch 820/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7064 - acc: 0.7139 - val_loss: 0.8070 - val_acc: 0.6778
Epoch 821/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7063 - acc: 0.7139 - val_loss: 0.8070 - val_acc: 0.6778
Epoch 822/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7062 - acc: 0.7153 - val_loss: 0.8063 - val_acc: 0.6778
Epoch 823/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7061 - acc: 0.7111 - val_loss: 0.8069 - val_acc: 0.6778
Epoch 824/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7060 - acc: 0.7153 - val_loss: 0.8065 - val_acc: 0.6778
Epoch 825/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7059 - acc: 0.7139 - val_loss: 0.8062 - val_acc: 0.6778
Epoch 826/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7058 - acc: 0.7139 - val_loss: 0.8068 - val_acc: 0.6778
Epoch 827/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7057 - acc: 0.7139 - val_loss: 0.8063 - val_acc: 0.6778
Epoch 828/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7056 - acc: 0.7153 - val_loss: 0.8062 - val_acc: 0.6778
Epoch 829/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7055 - acc: 0.7111 - val_loss: 0.8066 - val_acc: 0.6778
Epoch 830/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7055 - acc: 0.7111 - val_loss: 0.8061 - val_acc: 0.6778
Epoch 831/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7055 - acc: 0.7125 - val_loss: 0.8067 - val_acc: 0.6778
Epoch 832/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7055 - acc: 0.7097 - val_loss: 0.8068 - val_acc: 0.6778
Epoch 833/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7058 - acc: 0.7111 - val_loss: 0.8073 - val_acc: 0.6778
Epoch 834/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7064 - acc: 0.7056 - val_loss: 0.8084 - val_acc: 0.6611
Epoch 835/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7077 - acc: 0.7097 - val_loss: 0.8114 - val_acc: 0.6611
Epoch 836/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7099 - acc: 0.7028 - val_loss: 0.8152 - val_acc: 0.6444
Epoch 837/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7151 - acc: 0.7014 - val_loss: 0.8221 - val_acc: 0.6444
Epoch 838/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7205 - acc: 0.6875 - val_loss: 0.8313 - val_acc: 0.6333
Epoch 839/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7317 - acc: 0.6958 - val_loss: 0.8288 - val_acc: 0.6333
Epoch 840/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7283 - acc: 0.6806 - val_loss: 0.8238 - val_acc: 0.6333
Epoch 841/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7231 - acc: 0.6972 - val_loss: 0.8105 - val_acc: 0.6556
Epoch 842/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7086 - acc: 0.7056 - val_loss: 0.8093 - val_acc: 0.6667
Epoch 843/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7054 - acc: 0.7111 - val_loss: 0.8158 - val_acc: 0.6444
Epoch 844/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7130 - acc: 0.7069 - val_loss: 0.8197 - val_acc: 0.6389
Epoch 845/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7181 - acc: 0.6903 - val_loss: 0.8187 - val_acc: 0.6389
Epoch 846/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7184 - acc: 0.7042 - val_loss: 0.8083 - val_acc: 0.6556
Epoch 847/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7083 - acc: 0.7069 - val_loss: 0.8060 - val_acc: 0.6778
Epoch 848/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7039 - acc: 0.7097 - val_loss: 0.8137 - val_acc: 0.6500
Epoch 849/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7082 - acc: 0.7125 - val_loss: 0.8178 - val_acc: 0.6500
Epoch 850/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7128 - acc: 0.7000 - val_loss: 0.8141 - val_acc: 0.6500
Epoch 851/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7135 - acc: 0.7056 - val_loss: 0.8079 - val_acc: 0.6667
Epoch 852/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7070 - acc: 0.7069 - val_loss: 0.8035 - val_acc: 0.6778
Epoch 853/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7038 - acc: 0.7083 - val_loss: 0.8094 - val_acc: 0.6611
Epoch 854/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7068 - acc: 0.7125 - val_loss: 0.8140 - val_acc: 0.6611
Epoch 855/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7097 - acc: 0.7014 - val_loss: 0.8091 - val_acc: 0.6556
Epoch 856/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7086 - acc: 0.7028 - val_loss: 0.8064 - val_acc: 0.6778
Epoch 857/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7043 - acc: 0.7083 - val_loss: 0.8045 - val_acc: 0.6778
Epoch 858/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7034 - acc: 0.7111 - val_loss: 0.8073 - val_acc: 0.6667
Epoch 859/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7057 - acc: 0.7125 - val_loss: 0.8124 - val_acc: 0.6667
Epoch 860/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7069 - acc: 0.7083 - val_loss: 0.8080 - val_acc: 0.6556
Epoch 861/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7057 - acc: 0.7111 - val_loss: 0.8063 - val_acc: 0.6778
Epoch 862/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7030 - acc: 0.7097 - val_loss: 0.8041 - val_acc: 0.6778
Epoch 863/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7025 - acc: 0.7111 - val_loss: 0.8041 - val_acc: 0.6722
Epoch 864/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7038 - acc: 0.7111 - val_loss: 0.8088 - val_acc: 0.6778
Epoch 865/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7046 - acc: 0.7069 - val_loss: 0.8070 - val_acc: 0.6611
Epoch 866/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7042 - acc: 0.7139 - val_loss: 0.8064 - val_acc: 0.6778
Epoch 867/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7026 - acc: 0.7097 - val_loss: 0.8038 - val_acc: 0.6778
Epoch 868/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7018 - acc: 0.7139 - val_loss: 0.8024 - val_acc: 0.6778
Epoch 869/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7020 - acc: 0.7139 - val_loss: 0.8054 - val_acc: 0.6778
Epoch 870/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7027 - acc: 0.7083 - val_loss: 0.8050 - val_acc: 0.6611
Epoch 871/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7030 - acc: 0.7125 - val_loss: 0.8052 - val_acc: 0.6778
Epoch 872/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7025 - acc: 0.7083 - val_loss: 0.8027 - val_acc: 0.6778
Epoch 873/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7017 - acc: 0.7125 - val_loss: 0.8020 - val_acc: 0.6778
Epoch 874/2000
720/720 [==============================] - 0s 40us/step - loss: 0.7011 - acc: 0.7139 - val_loss: 0.8030 - val_acc: 0.6778
Epoch 875/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7010 - acc: 0.7139 - val_loss: 0.8039 - val_acc: 0.6778
Epoch 876/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7013 - acc: 0.7139 - val_loss: 0.8049 - val_acc: 0.6778
Epoch 877/2000
720/720 [==============================] - 0s 31us/step - loss: 0.7016 - acc: 0.7097 - val_loss: 0.8035 - val_acc: 0.6722
Epoch 878/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7016 - acc: 0.7125 - val_loss: 0.8039 - val_acc: 0.6778
Epoch 879/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7013 - acc: 0.7111 - val_loss: 0.8024 - val_acc: 0.6778
Epoch 880/2000
720/720 [==============================] - 0s 35us/step - loss: 0.7009 - acc: 0.7139 - val_loss: 0.8036 - val_acc: 0.6778
Epoch 881/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7004 - acc: 0.7097 - val_loss: 0.8027 - val_acc: 0.6778
Epoch 882/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7002 - acc: 0.7125 - val_loss: 0.8029 - val_acc: 0.6778
Epoch 883/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7001 - acc: 0.7125 - val_loss: 0.8030 - val_acc: 0.6778
Epoch 884/2000
720/720 [==============================] - 0s 21us/step - loss: 0.7001 - acc: 0.7111 - val_loss: 0.8021 - val_acc: 0.6778
Epoch 885/2000
720/720 [==============================] - 0s 25us/step - loss: 0.7002 - acc: 0.7139 - val_loss: 0.8034 - val_acc: 0.6778
Epoch 886/2000
720/720 [==============================] - 0s 19us/step - loss: 0.7002 - acc: 0.7097 - val_loss: 0.8022 - val_acc: 0.6778
Epoch 887/2000
720/720 [==============================] - 0s 39us/step - loss: 0.7002 - acc: 0.7139 - val_loss: 0.8040 - val_acc: 0.6778
Epoch 888/2000
720/720 [==============================] - 0s 44us/step - loss: 0.7002 - acc: 0.7097 - val_loss: 0.8024 - val_acc: 0.6778
Epoch 889/2000
720/720 [==============================] - 0s 39us/step - loss: 0.7001 - acc: 0.7125 - val_loss: 0.8031 - val_acc: 0.6778
Epoch 890/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7000 - acc: 0.7097 - val_loss: 0.8019 - val_acc: 0.6778
Epoch 891/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6999 - acc: 0.7125 - val_loss: 0.8032 - val_acc: 0.6778
Epoch 892/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6997 - acc: 0.7111 - val_loss: 0.8025 - val_acc: 0.6778
Epoch 893/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6997 - acc: 0.7139 - val_loss: 0.8039 - val_acc: 0.6778
Epoch 894/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6996 - acc: 0.7097 - val_loss: 0.8020 - val_acc: 0.6722
Epoch 895/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6996 - acc: 0.7139 - val_loss: 0.8036 - val_acc: 0.6778
Epoch 896/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6996 - acc: 0.7097 - val_loss: 0.8019 - val_acc: 0.6722
Epoch 897/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6998 - acc: 0.7111 - val_loss: 0.8047 - val_acc: 0.6778
Epoch 898/2000
720/720 [==============================] - 0s 21us/step - loss: 0.7000 - acc: 0.7111 - val_loss: 0.8028 - val_acc: 0.6722
Epoch 899/2000
720/720 [==============================] - 0s 36us/step - loss: 0.7006 - acc: 0.7083 - val_loss: 0.8061 - val_acc: 0.6778
Epoch 900/2000
720/720 [==============================] - 0s 26us/step - loss: 0.7013 - acc: 0.7097 - val_loss: 0.8043 - val_acc: 0.6611
Epoch 901/2000
720/720 [==============================] - 0s 37us/step - loss: 0.7030 - acc: 0.7069 - val_loss: 0.8097 - val_acc: 0.6611
Epoch 902/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7045 - acc: 0.7028 - val_loss: 0.8086 - val_acc: 0.6444
Epoch 903/2000
720/720 [==============================] - 0s 36us/step - loss: 0.7077 - acc: 0.7028 - val_loss: 0.8150 - val_acc: 0.6556
Epoch 904/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7089 - acc: 0.6972 - val_loss: 0.8122 - val_acc: 0.6333
Epoch 905/2000
720/720 [==============================] - 0s 28us/step - loss: 0.7116 - acc: 0.7028 - val_loss: 0.8144 - val_acc: 0.6611
Epoch 906/2000
720/720 [==============================] - 0s 19us/step - loss: 0.7084 - acc: 0.6944 - val_loss: 0.8071 - val_acc: 0.6444
Epoch 907/2000
720/720 [==============================] - 0s 22us/step - loss: 0.7052 - acc: 0.7028 - val_loss: 0.8050 - val_acc: 0.6722
Epoch 908/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7001 - acc: 0.7125 - val_loss: 0.8023 - val_acc: 0.6778
Epoch 909/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6976 - acc: 0.7153 - val_loss: 0.8018 - val_acc: 0.6778
Epoch 910/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6982 - acc: 0.7125 - val_loss: 0.8070 - val_acc: 0.6722
Epoch 911/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7006 - acc: 0.7097 - val_loss: 0.8063 - val_acc: 0.6667
Epoch 912/2000
720/720 [==============================] - 0s 33us/step - loss: 0.7039 - acc: 0.7069 - val_loss: 0.8105 - val_acc: 0.6556
Epoch 913/2000
720/720 [==============================] - 0s 40us/step - loss: 0.7048 - acc: 0.7069 - val_loss: 0.8079 - val_acc: 0.6500
Epoch 914/2000
720/720 [==============================] - 0s 32us/step - loss: 0.7054 - acc: 0.7069 - val_loss: 0.8079 - val_acc: 0.6611
Epoch 915/2000
720/720 [==============================] - 0s 21us/step - loss: 0.7022 - acc: 0.7083 - val_loss: 0.8035 - val_acc: 0.6722
Epoch 916/2000
720/720 [==============================] - 0s 32us/step - loss: 0.6993 - acc: 0.7125 - val_loss: 0.8015 - val_acc: 0.6778
Epoch 917/2000
720/720 [==============================] - 0s 31us/step - loss: 0.6970 - acc: 0.7083 - val_loss: 0.8018 - val_acc: 0.6778
Epoch 918/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6968 - acc: 0.7125 - val_loss: 0.8013 - val_acc: 0.6722
Epoch 919/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6982 - acc: 0.7125 - val_loss: 0.8048 - val_acc: 0.6778
Epoch 920/2000
720/720 [==============================] - 0s 33us/step - loss: 0.6995 - acc: 0.7097 - val_loss: 0.8036 - val_acc: 0.6611
Epoch 921/2000
720/720 [==============================] - 0s 24us/step - loss: 0.7003 - acc: 0.7139 - val_loss: 0.8045 - val_acc: 0.6722
Epoch 922/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6994 - acc: 0.7097 - val_loss: 0.8023 - val_acc: 0.6722
Epoch 923/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6981 - acc: 0.7153 - val_loss: 0.8019 - val_acc: 0.6778
Epoch 924/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6966 - acc: 0.7125 - val_loss: 0.8009 - val_acc: 0.6778
Epoch 925/2000
720/720 [==============================] - 0s 29us/step - loss: 0.6958 - acc: 0.7167 - val_loss: 0.8004 - val_acc: 0.6778
Epoch 926/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6957 - acc: 0.7153 - val_loss: 0.8008 - val_acc: 0.6778
Epoch 927/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6962 - acc: 0.7111 - val_loss: 0.8008 - val_acc: 0.6722
Epoch 928/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6969 - acc: 0.7181 - val_loss: 0.8023 - val_acc: 0.6778
Epoch 929/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6974 - acc: 0.7125 - val_loss: 0.8015 - val_acc: 0.6722
Epoch 930/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6977 - acc: 0.7139 - val_loss: 0.8034 - val_acc: 0.6778
Epoch 931/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6975 - acc: 0.7125 - val_loss: 0.8007 - val_acc: 0.6722
Epoch 932/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6972 - acc: 0.7097 - val_loss: 0.8028 - val_acc: 0.6778
Epoch 933/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6966 - acc: 0.7097 - val_loss: 0.7989 - val_acc: 0.6722
Epoch 934/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6960 - acc: 0.7125 - val_loss: 0.8012 - val_acc: 0.6778
Epoch 935/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6954 - acc: 0.7111 - val_loss: 0.7979 - val_acc: 0.6778
Epoch 936/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6950 - acc: 0.7181 - val_loss: 0.8001 - val_acc: 0.6778
Epoch 937/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6946 - acc: 0.7139 - val_loss: 0.7983 - val_acc: 0.6778
Epoch 938/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6944 - acc: 0.7153 - val_loss: 0.7995 - val_acc: 0.6778
Epoch 939/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6942 - acc: 0.7167 - val_loss: 0.7991 - val_acc: 0.6778
Epoch 940/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6941 - acc: 0.7153 - val_loss: 0.7989 - val_acc: 0.6778
Epoch 941/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6941 - acc: 0.7139 - val_loss: 0.7998 - val_acc: 0.6778
Epoch 942/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6941 - acc: 0.7125 - val_loss: 0.7981 - val_acc: 0.6778
Epoch 943/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6942 - acc: 0.7194 - val_loss: 0.8005 - val_acc: 0.6778
Epoch 944/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6945 - acc: 0.7111 - val_loss: 0.7980 - val_acc: 0.6722
Epoch 945/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6950 - acc: 0.7097 - val_loss: 0.8032 - val_acc: 0.6778
Epoch 946/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6960 - acc: 0.7111 - val_loss: 0.8002 - val_acc: 0.6667
Epoch 947/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6979 - acc: 0.7083 - val_loss: 0.8091 - val_acc: 0.6611
Epoch 948/2000
720/720 [==============================] - 0s 10us/step - loss: 0.7005 - acc: 0.7042 - val_loss: 0.8066 - val_acc: 0.6389
Epoch 949/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7056 - acc: 0.7000 - val_loss: 0.8182 - val_acc: 0.6556
Epoch 950/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7088 - acc: 0.6986 - val_loss: 0.8149 - val_acc: 0.6278
Epoch 951/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7142 - acc: 0.6958 - val_loss: 0.8169 - val_acc: 0.6556
Epoch 952/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7086 - acc: 0.6986 - val_loss: 0.8063 - val_acc: 0.6389
Epoch 953/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7026 - acc: 0.7056 - val_loss: 0.8005 - val_acc: 0.6667
Epoch 954/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6952 - acc: 0.7111 - val_loss: 0.8043 - val_acc: 0.6722
Epoch 955/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6943 - acc: 0.7181 - val_loss: 0.8010 - val_acc: 0.6611
Epoch 956/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6983 - acc: 0.7042 - val_loss: 0.8145 - val_acc: 0.6611
Epoch 957/2000
720/720 [==============================] - 0s 39us/step - loss: 0.7019 - acc: 0.7069 - val_loss: 0.8055 - val_acc: 0.6500
Epoch 958/2000
720/720 [==============================] - 0s 14us/step - loss: 0.7026 - acc: 0.7056 - val_loss: 0.8064 - val_acc: 0.6611
Epoch 959/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6983 - acc: 0.7097 - val_loss: 0.8014 - val_acc: 0.6722
Epoch 960/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6953 - acc: 0.7250 - val_loss: 0.7976 - val_acc: 0.6722
Epoch 961/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6945 - acc: 0.7111 - val_loss: 0.8088 - val_acc: 0.6722
Epoch 962/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6964 - acc: 0.7236 - val_loss: 0.7978 - val_acc: 0.6556
Epoch 963/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6968 - acc: 0.7028 - val_loss: 0.8071 - val_acc: 0.6722
Epoch 964/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6959 - acc: 0.7194 - val_loss: 0.7963 - val_acc: 0.6722
Epoch 965/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6929 - acc: 0.7139 - val_loss: 0.7979 - val_acc: 0.6722
Epoch 966/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6917 - acc: 0.7153 - val_loss: 0.8024 - val_acc: 0.6778
Epoch 967/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6927 - acc: 0.7222 - val_loss: 0.7955 - val_acc: 0.6667
Epoch 968/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6940 - acc: 0.7069 - val_loss: 0.8050 - val_acc: 0.6778
Epoch 969/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6943 - acc: 0.7208 - val_loss: 0.7954 - val_acc: 0.6667
Epoch 970/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6925 - acc: 0.7139 - val_loss: 0.7990 - val_acc: 0.6778
Epoch 971/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6911 - acc: 0.7222 - val_loss: 0.7996 - val_acc: 0.6778
Epoch 972/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6912 - acc: 0.7153 - val_loss: 0.7959 - val_acc: 0.6667
Epoch 973/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6921 - acc: 0.7111 - val_loss: 0.8031 - val_acc: 0.6778
Epoch 974/2000
720/720 [==============================] - 0s 36us/step - loss: 0.6926 - acc: 0.7194 - val_loss: 0.7952 - val_acc: 0.6667
Epoch 975/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6920 - acc: 0.7097 - val_loss: 0.7992 - val_acc: 0.6778
Epoch 976/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6909 - acc: 0.7181 - val_loss: 0.7962 - val_acc: 0.6778
Epoch 977/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6903 - acc: 0.7139 - val_loss: 0.7952 - val_acc: 0.6722
Epoch 978/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6904 - acc: 0.7139 - val_loss: 0.7994 - val_acc: 0.6778
Epoch 979/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6909 - acc: 0.7194 - val_loss: 0.7936 - val_acc: 0.6667
Epoch 980/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6910 - acc: 0.7139 - val_loss: 0.7993 - val_acc: 0.6778
Epoch 981/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6908 - acc: 0.7208 - val_loss: 0.7942 - val_acc: 0.6722
Epoch 982/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6902 - acc: 0.7181 - val_loss: 0.7969 - val_acc: 0.6778
Epoch 983/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6897 - acc: 0.7167 - val_loss: 0.7959 - val_acc: 0.6778
Epoch 984/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6895 - acc: 0.7153 - val_loss: 0.7940 - val_acc: 0.6722
Epoch 985/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6896 - acc: 0.7111 - val_loss: 0.7978 - val_acc: 0.6778
Epoch 986/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6898 - acc: 0.7250 - val_loss: 0.7939 - val_acc: 0.6722
Epoch 987/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6900 - acc: 0.7139 - val_loss: 0.7993 - val_acc: 0.6778
Epoch 988/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6902 - acc: 0.7264 - val_loss: 0.7945 - val_acc: 0.6722
Epoch 989/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6903 - acc: 0.7125 - val_loss: 0.7991 - val_acc: 0.6778
Epoch 990/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6910 - acc: 0.7236 - val_loss: 0.7978 - val_acc: 0.6667
Epoch 991/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6924 - acc: 0.7069 - val_loss: 0.8032 - val_acc: 0.6556
Epoch 992/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6965 - acc: 0.7181 - val_loss: 0.8091 - val_acc: 0.6444
Epoch 993/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7027 - acc: 0.7000 - val_loss: 0.8218 - val_acc: 0.6278
Epoch 994/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7177 - acc: 0.7042 - val_loss: 0.8273 - val_acc: 0.6222
Epoch 995/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7221 - acc: 0.6792 - val_loss: 0.8327 - val_acc: 0.6278
Epoch 996/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7287 - acc: 0.6958 - val_loss: 0.8088 - val_acc: 0.6444
Epoch 997/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7033 - acc: 0.6958 - val_loss: 0.8018 - val_acc: 0.6722
Epoch 998/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6905 - acc: 0.7208 - val_loss: 0.8033 - val_acc: 0.6333
Epoch 999/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6973 - acc: 0.7083 - val_loss: 0.8183 - val_acc: 0.6444
Epoch 1000/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7063 - acc: 0.6958 - val_loss: 0.8132 - val_acc: 0.6333
Epoch 1001/2000
720/720 [==============================] - 0s 11us/step - loss: 0.7087 - acc: 0.7042 - val_loss: 0.7967 - val_acc: 0.6444
Epoch 1002/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6951 - acc: 0.7083 - val_loss: 0.8014 - val_acc: 0.6778
Epoch 1003/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6907 - acc: 0.7208 - val_loss: 0.8047 - val_acc: 0.6444
Epoch 1004/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6982 - acc: 0.7056 - val_loss: 0.8194 - val_acc: 0.6556
Epoch 1005/2000
720/720 [==============================] - 0s 12us/step - loss: 0.7020 - acc: 0.6972 - val_loss: 0.8052 - val_acc: 0.6556
Epoch 1006/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6987 - acc: 0.7125 - val_loss: 0.7933 - val_acc: 0.6611
Epoch 1007/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6905 - acc: 0.7139 - val_loss: 0.8022 - val_acc: 0.6722
Epoch 1008/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6916 - acc: 0.7181 - val_loss: 0.8024 - val_acc: 0.6389
Epoch 1009/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6975 - acc: 0.7028 - val_loss: 0.8087 - val_acc: 0.6611
Epoch 1010/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6943 - acc: 0.7028 - val_loss: 0.7958 - val_acc: 0.6778
Epoch 1011/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6885 - acc: 0.7264 - val_loss: 0.7903 - val_acc: 0.6667
Epoch 1012/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6896 - acc: 0.7153 - val_loss: 0.8069 - val_acc: 0.6722
Epoch 1013/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6936 - acc: 0.7153 - val_loss: 0.7992 - val_acc: 0.6611
Epoch 1014/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6923 - acc: 0.7042 - val_loss: 0.7998 - val_acc: 0.6722
Epoch 1015/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6877 - acc: 0.7153 - val_loss: 0.7963 - val_acc: 0.6778
Epoch 1016/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6875 - acc: 0.7181 - val_loss: 0.7924 - val_acc: 0.6611
Epoch 1017/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6906 - acc: 0.7042 - val_loss: 0.8049 - val_acc: 0.6722
Epoch 1018/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6910 - acc: 0.7181 - val_loss: 0.7952 - val_acc: 0.6667
Epoch 1019/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6878 - acc: 0.7153 - val_loss: 0.7949 - val_acc: 0.6778
Epoch 1020/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6864 - acc: 0.7153 - val_loss: 0.7977 - val_acc: 0.6778
Epoch 1021/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6880 - acc: 0.7167 - val_loss: 0.7945 - val_acc: 0.6611
Epoch 1022/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6893 - acc: 0.7097 - val_loss: 0.8007 - val_acc: 0.6778
Epoch 1023/2000
720/720 [==============================] - 0s 47us/step - loss: 0.6881 - acc: 0.7208 - val_loss: 0.7917 - val_acc: 0.6722
Epoch 1024/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6859 - acc: 0.7139 - val_loss: 0.7909 - val_acc: 0.6778
Epoch 1025/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6861 - acc: 0.7194 - val_loss: 0.7967 - val_acc: 0.6778
Epoch 1026/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6874 - acc: 0.7153 - val_loss: 0.7939 - val_acc: 0.6667
Epoch 1027/2000
720/720 [==============================] - 0s 36us/step - loss: 0.6880 - acc: 0.7139 - val_loss: 0.7957 - val_acc: 0.6778
Epoch 1028/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6867 - acc: 0.7181 - val_loss: 0.7904 - val_acc: 0.6778
Epoch 1029/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6854 - acc: 0.7222 - val_loss: 0.7907 - val_acc: 0.6722
Epoch 1030/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6852 - acc: 0.7181 - val_loss: 0.7982 - val_acc: 0.6778
Epoch 1031/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6860 - acc: 0.7181 - val_loss: 0.7929 - val_acc: 0.6667
Epoch 1032/2000
720/720 [==============================] - 0s 33us/step - loss: 0.6864 - acc: 0.7125 - val_loss: 0.7946 - val_acc: 0.6778
Epoch 1033/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6859 - acc: 0.7194 - val_loss: 0.7899 - val_acc: 0.6778
Epoch 1034/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6850 - acc: 0.7250 - val_loss: 0.7925 - val_acc: 0.6722
Epoch 1035/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6844 - acc: 0.7153 - val_loss: 0.7963 - val_acc: 0.6778
Epoch 1036/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6847 - acc: 0.7208 - val_loss: 0.7907 - val_acc: 0.6722
Epoch 1037/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6850 - acc: 0.7181 - val_loss: 0.7949 - val_acc: 0.6778
Epoch 1038/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6852 - acc: 0.7181 - val_loss: 0.7897 - val_acc: 0.6667
Epoch 1039/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6848 - acc: 0.7167 - val_loss: 0.7952 - val_acc: 0.6778
Epoch 1040/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6842 - acc: 0.7208 - val_loss: 0.7915 - val_acc: 0.6722
Epoch 1041/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6838 - acc: 0.7153 - val_loss: 0.7910 - val_acc: 0.6778
Epoch 1042/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6837 - acc: 0.7222 - val_loss: 0.7920 - val_acc: 0.6778
Epoch 1043/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6838 - acc: 0.7208 - val_loss: 0.7914 - val_acc: 0.6778
Epoch 1044/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6840 - acc: 0.7222 - val_loss: 0.7943 - val_acc: 0.6778
Epoch 1045/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6840 - acc: 0.7167 - val_loss: 0.7912 - val_acc: 0.6778
Epoch 1046/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6839 - acc: 0.7222 - val_loss: 0.7929 - val_acc: 0.6722
Epoch 1047/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6836 - acc: 0.7181 - val_loss: 0.7925 - val_acc: 0.6778
Epoch 1048/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6835 - acc: 0.7208 - val_loss: 0.7914 - val_acc: 0.6722
Epoch 1049/2000
720/720 [==============================] - 0s 33us/step - loss: 0.6834 - acc: 0.7181 - val_loss: 0.7935 - val_acc: 0.6778
Epoch 1050/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6835 - acc: 0.7250 - val_loss: 0.7897 - val_acc: 0.6722
Epoch 1051/2000
720/720 [==============================] - 0s 33us/step - loss: 0.6840 - acc: 0.7167 - val_loss: 0.7981 - val_acc: 0.6778
Epoch 1052/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6851 - acc: 0.7278 - val_loss: 0.7903 - val_acc: 0.6556
Epoch 1053/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6867 - acc: 0.7139 - val_loss: 0.8047 - val_acc: 0.6778
Epoch 1054/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6903 - acc: 0.7181 - val_loss: 0.7928 - val_acc: 0.6389
Epoch 1055/2000
720/720 [==============================] - 0s 39us/step - loss: 0.6934 - acc: 0.7111 - val_loss: 0.8166 - val_acc: 0.6667
Epoch 1056/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6996 - acc: 0.7194 - val_loss: 0.7995 - val_acc: 0.6444
Epoch 1057/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6996 - acc: 0.7014 - val_loss: 0.8138 - val_acc: 0.6611
Epoch 1058/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6996 - acc: 0.7194 - val_loss: 0.7985 - val_acc: 0.6556
Epoch 1059/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6922 - acc: 0.7083 - val_loss: 0.7956 - val_acc: 0.6722
Epoch 1060/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6889 - acc: 0.7153 - val_loss: 0.8098 - val_acc: 0.6722
Epoch 1061/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6899 - acc: 0.7111 - val_loss: 0.7898 - val_acc: 0.6667
Epoch 1062/2000
720/720 [==============================] - 0s 18us/step - loss: 0.6908 - acc: 0.7056 - val_loss: 0.8067 - val_acc: 0.6722
Epoch 1063/2000
720/720 [==============================] - 0s 44us/step - loss: 0.6905 - acc: 0.7139 - val_loss: 0.7861 - val_acc: 0.6611
Epoch 1064/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6845 - acc: 0.7181 - val_loss: 0.7919 - val_acc: 0.6778
Epoch 1065/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6822 - acc: 0.7236 - val_loss: 0.8031 - val_acc: 0.6778
Epoch 1066/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6850 - acc: 0.7194 - val_loss: 0.7916 - val_acc: 0.6722
Epoch 1067/2000
720/720 [==============================] - 0s 18us/step - loss: 0.6883 - acc: 0.7042 - val_loss: 0.8075 - val_acc: 0.6722
Epoch 1068/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6889 - acc: 0.7125 - val_loss: 0.7907 - val_acc: 0.6611
Epoch 1069/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6854 - acc: 0.7083 - val_loss: 0.7928 - val_acc: 0.6778
Epoch 1070/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6836 - acc: 0.7167 - val_loss: 0.7968 - val_acc: 0.6778
Epoch 1071/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6849 - acc: 0.7306 - val_loss: 0.7872 - val_acc: 0.6667
Epoch 1072/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6853 - acc: 0.7167 - val_loss: 0.7993 - val_acc: 0.6778
Epoch 1073/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6839 - acc: 0.7208 - val_loss: 0.7909 - val_acc: 0.6722
Epoch 1074/2000
720/720 [==============================] - 0s 36us/step - loss: 0.6811 - acc: 0.7181 - val_loss: 0.7909 - val_acc: 0.6722
Epoch 1075/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6805 - acc: 0.7194 - val_loss: 0.7969 - val_acc: 0.6778
Epoch 1076/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6821 - acc: 0.7250 - val_loss: 0.7877 - val_acc: 0.6611
Epoch 1077/2000
720/720 [==============================] - 0s 29us/step - loss: 0.6827 - acc: 0.7194 - val_loss: 0.7949 - val_acc: 0.6778
Epoch 1078/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6822 - acc: 0.7222 - val_loss: 0.7888 - val_acc: 0.6722
Epoch 1079/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6812 - acc: 0.7194 - val_loss: 0.7875 - val_acc: 0.6722
Epoch 1080/2000
720/720 [==============================] - 0s 49us/step - loss: 0.6817 - acc: 0.7181 - val_loss: 0.7970 - val_acc: 0.6778
Epoch 1081/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6829 - acc: 0.7167 - val_loss: 0.7895 - val_acc: 0.6611
Epoch 1082/2000
720/720 [==============================] - 0s 39us/step - loss: 0.6836 - acc: 0.7111 - val_loss: 0.7978 - val_acc: 0.6778
Epoch 1083/2000
720/720 [==============================] - 0s 46us/step - loss: 0.6831 - acc: 0.7208 - val_loss: 0.7904 - val_acc: 0.6722
Epoch 1084/2000
720/720 [==============================] - 0s 40us/step - loss: 0.6828 - acc: 0.7181 - val_loss: 0.7909 - val_acc: 0.6667
Epoch 1085/2000
720/720 [==============================] - 0s 39us/step - loss: 0.6827 - acc: 0.7181 - val_loss: 0.7952 - val_acc: 0.6722
Epoch 1086/2000
720/720 [==============================] - 0s 18us/step - loss: 0.6834 - acc: 0.7250 - val_loss: 0.7899 - val_acc: 0.6667
Epoch 1087/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6833 - acc: 0.7139 - val_loss: 0.7945 - val_acc: 0.6722
Epoch 1088/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6831 - acc: 0.7250 - val_loss: 0.7908 - val_acc: 0.6556
Epoch 1089/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6822 - acc: 0.7181 - val_loss: 0.7911 - val_acc: 0.6722
Epoch 1090/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6821 - acc: 0.7208 - val_loss: 0.7968 - val_acc: 0.6667
Epoch 1091/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6823 - acc: 0.7181 - val_loss: 0.7895 - val_acc: 0.6667
Epoch 1092/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6831 - acc: 0.7167 - val_loss: 0.7962 - val_acc: 0.6667
Epoch 1093/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6830 - acc: 0.7222 - val_loss: 0.7894 - val_acc: 0.6667
Epoch 1094/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6830 - acc: 0.7208 - val_loss: 0.7930 - val_acc: 0.6667
Epoch 1095/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6822 - acc: 0.7194 - val_loss: 0.7933 - val_acc: 0.6722
Epoch 1096/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6823 - acc: 0.7264 - val_loss: 0.7902 - val_acc: 0.6722
Epoch 1097/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6819 - acc: 0.7139 - val_loss: 0.7950 - val_acc: 0.6778
Epoch 1098/2000
720/720 [==============================] - 0s 40us/step - loss: 0.6816 - acc: 0.7250 - val_loss: 0.7897 - val_acc: 0.6667
Epoch 1099/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6805 - acc: 0.7222 - val_loss: 0.7916 - val_acc: 0.6778
Epoch 1100/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6794 - acc: 0.7250 - val_loss: 0.7901 - val_acc: 0.6722
Epoch 1101/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6786 - acc: 0.7181 - val_loss: 0.7865 - val_acc: 0.6722
Epoch 1102/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6785 - acc: 0.7222 - val_loss: 0.7915 - val_acc: 0.6778
Epoch 1103/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6785 - acc: 0.7194 - val_loss: 0.7854 - val_acc: 0.6667
Epoch 1104/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6784 - acc: 0.7167 - val_loss: 0.7916 - val_acc: 0.6778
Epoch 1105/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6781 - acc: 0.7181 - val_loss: 0.7866 - val_acc: 0.6722
Epoch 1106/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6777 - acc: 0.7194 - val_loss: 0.7899 - val_acc: 0.6722
Epoch 1107/2000
720/720 [==============================] - 0s 18us/step - loss: 0.6774 - acc: 0.7194 - val_loss: 0.7883 - val_acc: 0.6778
Epoch 1108/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6773 - acc: 0.7208 - val_loss: 0.7872 - val_acc: 0.6722
Epoch 1109/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6774 - acc: 0.7208 - val_loss: 0.7889 - val_acc: 0.6778
Epoch 1110/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6777 - acc: 0.7222 - val_loss: 0.7863 - val_acc: 0.6611
Epoch 1111/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6781 - acc: 0.7194 - val_loss: 0.7904 - val_acc: 0.6778
Epoch 1112/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6790 - acc: 0.7222 - val_loss: 0.7891 - val_acc: 0.6611
Epoch 1113/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6802 - acc: 0.7167 - val_loss: 0.7936 - val_acc: 0.6722
Epoch 1114/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6830 - acc: 0.7222 - val_loss: 0.7972 - val_acc: 0.6611
Epoch 1115/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6863 - acc: 0.7083 - val_loss: 0.8026 - val_acc: 0.6444
Epoch 1116/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6943 - acc: 0.7083 - val_loss: 0.8101 - val_acc: 0.6444
Epoch 1117/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6975 - acc: 0.6958 - val_loss: 0.8103 - val_acc: 0.6278
Epoch 1118/2000
720/720 [==============================] - 0s 13us/step - loss: 0.7049 - acc: 0.7056 - val_loss: 0.8064 - val_acc: 0.6500
Epoch 1119/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6934 - acc: 0.6986 - val_loss: 0.7917 - val_acc: 0.6667
Epoch 1120/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6830 - acc: 0.7167 - val_loss: 0.7879 - val_acc: 0.6722
Epoch 1121/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6764 - acc: 0.7208 - val_loss: 0.7944 - val_acc: 0.6722
Epoch 1122/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6796 - acc: 0.7181 - val_loss: 0.7959 - val_acc: 0.6556
Epoch 1123/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6878 - acc: 0.7167 - val_loss: 0.8041 - val_acc: 0.6500
Epoch 1124/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6889 - acc: 0.7056 - val_loss: 0.7967 - val_acc: 0.6667
Epoch 1125/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6868 - acc: 0.7139 - val_loss: 0.7919 - val_acc: 0.6611
Epoch 1126/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6790 - acc: 0.7208 - val_loss: 0.7909 - val_acc: 0.6778
Epoch 1127/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6759 - acc: 0.7194 - val_loss: 0.7870 - val_acc: 0.6611
Epoch 1128/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6778 - acc: 0.7153 - val_loss: 0.7994 - val_acc: 0.6611
Epoch 1129/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6810 - acc: 0.7208 - val_loss: 0.7902 - val_acc: 0.6611
Epoch 1130/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6818 - acc: 0.7139 - val_loss: 0.7921 - val_acc: 0.6778
Epoch 1131/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6780 - acc: 0.7208 - val_loss: 0.7872 - val_acc: 0.6778
Epoch 1132/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6752 - acc: 0.7194 - val_loss: 0.7845 - val_acc: 0.6722
Epoch 1133/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6755 - acc: 0.7222 - val_loss: 0.7944 - val_acc: 0.6778
Epoch 1134/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6778 - acc: 0.7194 - val_loss: 0.7840 - val_acc: 0.6611
Epoch 1135/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6789 - acc: 0.7139 - val_loss: 0.7936 - val_acc: 0.6778
Epoch 1136/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6776 - acc: 0.7181 - val_loss: 0.7833 - val_acc: 0.6667
Epoch 1137/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6753 - acc: 0.7222 - val_loss: 0.7883 - val_acc: 0.6778
Epoch 1138/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6744 - acc: 0.7236 - val_loss: 0.7864 - val_acc: 0.6722
Epoch 1139/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6752 - acc: 0.7208 - val_loss: 0.7878 - val_acc: 0.6722
Epoch 1140/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6767 - acc: 0.7236 - val_loss: 0.7898 - val_acc: 0.6611
Epoch 1141/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6771 - acc: 0.7194 - val_loss: 0.7895 - val_acc: 0.6722
Epoch 1142/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6770 - acc: 0.7250 - val_loss: 0.7862 - val_acc: 0.6667
Epoch 1143/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6761 - acc: 0.7208 - val_loss: 0.7911 - val_acc: 0.6778
Epoch 1144/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6760 - acc: 0.7236 - val_loss: 0.7819 - val_acc: 0.6667
Epoch 1145/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6770 - acc: 0.7250 - val_loss: 0.8000 - val_acc: 0.6833
Epoch 1146/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6800 - acc: 0.7208 - val_loss: 0.7828 - val_acc: 0.6500
Epoch 1147/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6818 - acc: 0.7236 - val_loss: 0.8094 - val_acc: 0.6778
Epoch 1148/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6863 - acc: 0.7194 - val_loss: 0.7838 - val_acc: 0.6333
Epoch 1149/2000
720/720 [==============================] - 0s 29us/step - loss: 0.6839 - acc: 0.7208 - val_loss: 0.8041 - val_acc: 0.6778
Epoch 1150/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6829 - acc: 0.7208 - val_loss: 0.7844 - val_acc: 0.6611
Epoch 1151/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6779 - acc: 0.7167 - val_loss: 0.7886 - val_acc: 0.6722
Epoch 1152/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6755 - acc: 0.7250 - val_loss: 0.7927 - val_acc: 0.6722
Epoch 1153/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6756 - acc: 0.7167 - val_loss: 0.7829 - val_acc: 0.6611
Epoch 1154/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6770 - acc: 0.7125 - val_loss: 0.7970 - val_acc: 0.6778
Epoch 1155/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6771 - acc: 0.7167 - val_loss: 0.7812 - val_acc: 0.6667
Epoch 1156/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6744 - acc: 0.7236 - val_loss: 0.7875 - val_acc: 0.6778
Epoch 1157/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6727 - acc: 0.7236 - val_loss: 0.7880 - val_acc: 0.6722
Epoch 1158/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6732 - acc: 0.7194 - val_loss: 0.7845 - val_acc: 0.6611
Epoch 1159/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6752 - acc: 0.7181 - val_loss: 0.7948 - val_acc: 0.6667
Epoch 1160/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6763 - acc: 0.7194 - val_loss: 0.7843 - val_acc: 0.6667
Epoch 1161/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6758 - acc: 0.7167 - val_loss: 0.7876 - val_acc: 0.6556
Epoch 1162/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6742 - acc: 0.7208 - val_loss: 0.7864 - val_acc: 0.6778
Epoch 1163/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6737 - acc: 0.7222 - val_loss: 0.7817 - val_acc: 0.6667
Epoch 1164/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6742 - acc: 0.7236 - val_loss: 0.7933 - val_acc: 0.6778
Epoch 1165/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6751 - acc: 0.7194 - val_loss: 0.7823 - val_acc: 0.6667
Epoch 1166/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6745 - acc: 0.7222 - val_loss: 0.7910 - val_acc: 0.6778
Epoch 1167/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6735 - acc: 0.7222 - val_loss: 0.7841 - val_acc: 0.6722
Epoch 1168/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6723 - acc: 0.7222 - val_loss: 0.7838 - val_acc: 0.6722
Epoch 1169/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6722 - acc: 0.7194 - val_loss: 0.7878 - val_acc: 0.6778
Epoch 1170/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6728 - acc: 0.7222 - val_loss: 0.7805 - val_acc: 0.6667
Epoch 1171/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6733 - acc: 0.7153 - val_loss: 0.7881 - val_acc: 0.6778
Epoch 1172/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6730 - acc: 0.7208 - val_loss: 0.7824 - val_acc: 0.6722
Epoch 1173/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6725 - acc: 0.7153 - val_loss: 0.7850 - val_acc: 0.6778
Epoch 1174/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6720 - acc: 0.7222 - val_loss: 0.7873 - val_acc: 0.6778
Epoch 1175/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6724 - acc: 0.7194 - val_loss: 0.7828 - val_acc: 0.6667
Epoch 1176/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6730 - acc: 0.7222 - val_loss: 0.7911 - val_acc: 0.6778
Epoch 1177/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6739 - acc: 0.7236 - val_loss: 0.7827 - val_acc: 0.6611
Epoch 1178/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6741 - acc: 0.7208 - val_loss: 0.7903 - val_acc: 0.6722
Epoch 1179/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6748 - acc: 0.7208 - val_loss: 0.7857 - val_acc: 0.6611
Epoch 1180/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6752 - acc: 0.7139 - val_loss: 0.7902 - val_acc: 0.6611
Epoch 1181/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6774 - acc: 0.7194 - val_loss: 0.7930 - val_acc: 0.6611
Epoch 1182/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6789 - acc: 0.7111 - val_loss: 0.7935 - val_acc: 0.6500
Epoch 1183/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6829 - acc: 0.7125 - val_loss: 0.7965 - val_acc: 0.6611
Epoch 1184/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6819 - acc: 0.7069 - val_loss: 0.7931 - val_acc: 0.6556
Epoch 1185/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6819 - acc: 0.7167 - val_loss: 0.7887 - val_acc: 0.6611
Epoch 1186/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6765 - acc: 0.7125 - val_loss: 0.7886 - val_acc: 0.6778
Epoch 1187/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6729 - acc: 0.7208 - val_loss: 0.7804 - val_acc: 0.6611
Epoch 1188/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6709 - acc: 0.7306 - val_loss: 0.7907 - val_acc: 0.6778
Epoch 1189/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6711 - acc: 0.7222 - val_loss: 0.7818 - val_acc: 0.6611
Epoch 1190/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6719 - acc: 0.7222 - val_loss: 0.7898 - val_acc: 0.6611
Epoch 1191/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6728 - acc: 0.7208 - val_loss: 0.7866 - val_acc: 0.6667
Epoch 1192/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6743 - acc: 0.7194 - val_loss: 0.7870 - val_acc: 0.6611
Epoch 1193/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6750 - acc: 0.7125 - val_loss: 0.7935 - val_acc: 0.6778
Epoch 1194/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6767 - acc: 0.7208 - val_loss: 0.7851 - val_acc: 0.6556
Epoch 1195/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6764 - acc: 0.7181 - val_loss: 0.7965 - val_acc: 0.6833
Epoch 1196/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6761 - acc: 0.7208 - val_loss: 0.7823 - val_acc: 0.6611
Epoch 1197/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6733 - acc: 0.7250 - val_loss: 0.7901 - val_acc: 0.6778
Epoch 1198/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6708 - acc: 0.7236 - val_loss: 0.7796 - val_acc: 0.6722
Epoch 1199/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6686 - acc: 0.7236 - val_loss: 0.7805 - val_acc: 0.6722
Epoch 1200/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6681 - acc: 0.7208 - val_loss: 0.7827 - val_acc: 0.6778
Epoch 1201/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6691 - acc: 0.7222 - val_loss: 0.7787 - val_acc: 0.6667
Epoch 1202/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6706 - acc: 0.7236 - val_loss: 0.7895 - val_acc: 0.6833
Epoch 1203/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6721 - acc: 0.7208 - val_loss: 0.7824 - val_acc: 0.6611
Epoch 1204/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6723 - acc: 0.7153 - val_loss: 0.7902 - val_acc: 0.6778
Epoch 1205/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6721 - acc: 0.7208 - val_loss: 0.7850 - val_acc: 0.6611
Epoch 1206/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6709 - acc: 0.7181 - val_loss: 0.7839 - val_acc: 0.6722
Epoch 1207/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6703 - acc: 0.7208 - val_loss: 0.7859 - val_acc: 0.6722
Epoch 1208/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6697 - acc: 0.7236 - val_loss: 0.7779 - val_acc: 0.6667
Epoch 1209/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6697 - acc: 0.7194 - val_loss: 0.7863 - val_acc: 0.6778
Epoch 1210/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6693 - acc: 0.7264 - val_loss: 0.7770 - val_acc: 0.6667
Epoch 1211/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6686 - acc: 0.7250 - val_loss: 0.7853 - val_acc: 0.6778
Epoch 1212/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6679 - acc: 0.7222 - val_loss: 0.7792 - val_acc: 0.6722
Epoch 1213/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6671 - acc: 0.7222 - val_loss: 0.7823 - val_acc: 0.6778
Epoch 1214/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6667 - acc: 0.7208 - val_loss: 0.7815 - val_acc: 0.6722
Epoch 1215/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6665 - acc: 0.7222 - val_loss: 0.7790 - val_acc: 0.6722
Epoch 1216/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6667 - acc: 0.7250 - val_loss: 0.7834 - val_acc: 0.6778
Epoch 1217/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6671 - acc: 0.7222 - val_loss: 0.7780 - val_acc: 0.6667
Epoch 1218/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6674 - acc: 0.7250 - val_loss: 0.7856 - val_acc: 0.6778
Epoch 1219/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6678 - acc: 0.7264 - val_loss: 0.7795 - val_acc: 0.6722
Epoch 1220/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6682 - acc: 0.7181 - val_loss: 0.7866 - val_acc: 0.6667
Epoch 1221/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6688 - acc: 0.7222 - val_loss: 0.7821 - val_acc: 0.6667
Epoch 1222/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6701 - acc: 0.7181 - val_loss: 0.7871 - val_acc: 0.6611
Epoch 1223/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6717 - acc: 0.7153 - val_loss: 0.7883 - val_acc: 0.6611
Epoch 1224/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6758 - acc: 0.7194 - val_loss: 0.7904 - val_acc: 0.6444
Epoch 1225/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6789 - acc: 0.7097 - val_loss: 0.8017 - val_acc: 0.6444
Epoch 1226/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6865 - acc: 0.7181 - val_loss: 0.7950 - val_acc: 0.6556
Epoch 1227/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6867 - acc: 0.7056 - val_loss: 0.8081 - val_acc: 0.6500
Epoch 1228/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6882 - acc: 0.7181 - val_loss: 0.7882 - val_acc: 0.6500
Epoch 1229/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6784 - acc: 0.7194 - val_loss: 0.7931 - val_acc: 0.6833
Epoch 1230/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6701 - acc: 0.7236 - val_loss: 0.7808 - val_acc: 0.6722
Epoch 1231/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6661 - acc: 0.7208 - val_loss: 0.7855 - val_acc: 0.6611
Epoch 1232/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6688 - acc: 0.7236 - val_loss: 0.7895 - val_acc: 0.6611
Epoch 1233/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6757 - acc: 0.7222 - val_loss: 0.7887 - val_acc: 0.6500
Epoch 1234/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6782 - acc: 0.7153 - val_loss: 0.7936 - val_acc: 0.6556
Epoch 1235/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6781 - acc: 0.7222 - val_loss: 0.7888 - val_acc: 0.6556
Epoch 1236/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6712 - acc: 0.7153 - val_loss: 0.7822 - val_acc: 0.6722
Epoch 1237/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6666 - acc: 0.7208 - val_loss: 0.7872 - val_acc: 0.6833
Epoch 1238/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6660 - acc: 0.7181 - val_loss: 0.7790 - val_acc: 0.6667
Epoch 1239/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6684 - acc: 0.7264 - val_loss: 0.7883 - val_acc: 0.6778
Epoch 1240/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6712 - acc: 0.7194 - val_loss: 0.7792 - val_acc: 0.6500
Epoch 1241/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6706 - acc: 0.7208 - val_loss: 0.7823 - val_acc: 0.6778
Epoch 1242/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6685 - acc: 0.7250 - val_loss: 0.7815 - val_acc: 0.6722
Epoch 1243/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6658 - acc: 0.7208 - val_loss: 0.7770 - val_acc: 0.6722
Epoch 1244/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6650 - acc: 0.7250 - val_loss: 0.7859 - val_acc: 0.6833
Epoch 1245/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6658 - acc: 0.7222 - val_loss: 0.7766 - val_acc: 0.6667
Epoch 1246/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6666 - acc: 0.7292 - val_loss: 0.7867 - val_acc: 0.6833
Epoch 1247/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6671 - acc: 0.7236 - val_loss: 0.7775 - val_acc: 0.6667
Epoch 1248/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6661 - acc: 0.7236 - val_loss: 0.7808 - val_acc: 0.6833
Epoch 1249/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6651 - acc: 0.7208 - val_loss: 0.7797 - val_acc: 0.6722
Epoch 1250/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6642 - acc: 0.7236 - val_loss: 0.7760 - val_acc: 0.6667
Epoch 1251/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6642 - acc: 0.7250 - val_loss: 0.7843 - val_acc: 0.6833
Epoch 1252/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6648 - acc: 0.7222 - val_loss: 0.7742 - val_acc: 0.6500
Epoch 1253/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6652 - acc: 0.7306 - val_loss: 0.7865 - val_acc: 0.6833
Epoch 1254/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6655 - acc: 0.7208 - val_loss: 0.7747 - val_acc: 0.6500
Epoch 1255/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6648 - acc: 0.7306 - val_loss: 0.7842 - val_acc: 0.6833
Epoch 1256/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6641 - acc: 0.7222 - val_loss: 0.7760 - val_acc: 0.6722
Epoch 1257/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6634 - acc: 0.7278 - val_loss: 0.7801 - val_acc: 0.6722
Epoch 1258/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6630 - acc: 0.7250 - val_loss: 0.7788 - val_acc: 0.6778
Epoch 1259/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6630 - acc: 0.7194 - val_loss: 0.7781 - val_acc: 0.6611
Epoch 1260/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6633 - acc: 0.7222 - val_loss: 0.7815 - val_acc: 0.6833
Epoch 1261/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6637 - acc: 0.7208 - val_loss: 0.7778 - val_acc: 0.6667
Epoch 1262/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6639 - acc: 0.7250 - val_loss: 0.7823 - val_acc: 0.6833
Epoch 1263/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6641 - acc: 0.7222 - val_loss: 0.7786 - val_acc: 0.6667
Epoch 1264/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6641 - acc: 0.7264 - val_loss: 0.7806 - val_acc: 0.6833
Epoch 1265/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6644 - acc: 0.7236 - val_loss: 0.7809 - val_acc: 0.6667
Epoch 1266/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6648 - acc: 0.7194 - val_loss: 0.7793 - val_acc: 0.6722
Epoch 1267/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6662 - acc: 0.7208 - val_loss: 0.7868 - val_acc: 0.6611
Epoch 1268/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6676 - acc: 0.7125 - val_loss: 0.7811 - val_acc: 0.6556
Epoch 1269/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6710 - acc: 0.7111 - val_loss: 0.7955 - val_acc: 0.6500
Epoch 1270/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6732 - acc: 0.7083 - val_loss: 0.7852 - val_acc: 0.6444
Epoch 1271/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6772 - acc: 0.7069 - val_loss: 0.7985 - val_acc: 0.6500
Epoch 1272/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6756 - acc: 0.7069 - val_loss: 0.7829 - val_acc: 0.6611
Epoch 1273/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6736 - acc: 0.7069 - val_loss: 0.7861 - val_acc: 0.6667
Epoch 1274/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6670 - acc: 0.7139 - val_loss: 0.7791 - val_acc: 0.6833
Epoch 1275/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6628 - acc: 0.7208 - val_loss: 0.7758 - val_acc: 0.6556
Epoch 1276/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6620 - acc: 0.7319 - val_loss: 0.7888 - val_acc: 0.6833
Epoch 1277/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6643 - acc: 0.7250 - val_loss: 0.7774 - val_acc: 0.6667
Epoch 1278/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6666 - acc: 0.7250 - val_loss: 0.7927 - val_acc: 0.6722
Epoch 1279/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6675 - acc: 0.7194 - val_loss: 0.7784 - val_acc: 0.6722
Epoch 1280/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6664 - acc: 0.7139 - val_loss: 0.7830 - val_acc: 0.6611
Epoch 1281/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6642 - acc: 0.7208 - val_loss: 0.7820 - val_acc: 0.6833
Epoch 1282/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6636 - acc: 0.7222 - val_loss: 0.7756 - val_acc: 0.6556
Epoch 1283/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6647 - acc: 0.7292 - val_loss: 0.7939 - val_acc: 0.6833
Epoch 1284/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6676 - acc: 0.7208 - val_loss: 0.7754 - val_acc: 0.6556
Epoch 1285/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6680 - acc: 0.7278 - val_loss: 0.7947 - val_acc: 0.6833
Epoch 1286/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6682 - acc: 0.7236 - val_loss: 0.7745 - val_acc: 0.6611
Epoch 1287/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6647 - acc: 0.7278 - val_loss: 0.7808 - val_acc: 0.6833
Epoch 1288/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6627 - acc: 0.7236 - val_loss: 0.7795 - val_acc: 0.6611
Epoch 1289/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6622 - acc: 0.7236 - val_loss: 0.7737 - val_acc: 0.6667
Epoch 1290/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6631 - acc: 0.7250 - val_loss: 0.7860 - val_acc: 0.6833
Epoch 1291/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6633 - acc: 0.7250 - val_loss: 0.7740 - val_acc: 0.6667
Epoch 1292/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6620 - acc: 0.7292 - val_loss: 0.7814 - val_acc: 0.6833
Epoch 1293/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6604 - acc: 0.7236 - val_loss: 0.7771 - val_acc: 0.6722
Epoch 1294/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6596 - acc: 0.7278 - val_loss: 0.7750 - val_acc: 0.6722
Epoch 1295/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6600 - acc: 0.7292 - val_loss: 0.7817 - val_acc: 0.6722
Epoch 1296/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6609 - acc: 0.7278 - val_loss: 0.7728 - val_acc: 0.6667
Epoch 1297/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6614 - acc: 0.7306 - val_loss: 0.7799 - val_acc: 0.6778
Epoch 1298/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6611 - acc: 0.7250 - val_loss: 0.7749 - val_acc: 0.6778
Epoch 1299/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6608 - acc: 0.7250 - val_loss: 0.7762 - val_acc: 0.6667
Epoch 1300/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6610 - acc: 0.7236 - val_loss: 0.7827 - val_acc: 0.6833
Epoch 1301/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6625 - acc: 0.7222 - val_loss: 0.7764 - val_acc: 0.6556
Epoch 1302/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6645 - acc: 0.7181 - val_loss: 0.7913 - val_acc: 0.6778
Epoch 1303/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6679 - acc: 0.7194 - val_loss: 0.7810 - val_acc: 0.6722
Epoch 1304/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6700 - acc: 0.7208 - val_loss: 0.7953 - val_acc: 0.6667
Epoch 1305/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6742 - acc: 0.7222 - val_loss: 0.7880 - val_acc: 0.6611
Epoch 1306/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6742 - acc: 0.7153 - val_loss: 0.7923 - val_acc: 0.6500
Epoch 1307/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6769 - acc: 0.7181 - val_loss: 0.7920 - val_acc: 0.6667
Epoch 1308/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6716 - acc: 0.7069 - val_loss: 0.7801 - val_acc: 0.6722
Epoch 1309/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6683 - acc: 0.7153 - val_loss: 0.7855 - val_acc: 0.6778
Epoch 1310/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6623 - acc: 0.7236 - val_loss: 0.7734 - val_acc: 0.6667
Epoch 1311/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6591 - acc: 0.7333 - val_loss: 0.7790 - val_acc: 0.6833
Epoch 1312/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6599 - acc: 0.7236 - val_loss: 0.7830 - val_acc: 0.6722
Epoch 1313/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6631 - acc: 0.7167 - val_loss: 0.7834 - val_acc: 0.6722
Epoch 1314/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6674 - acc: 0.7181 - val_loss: 0.7886 - val_acc: 0.6667
Epoch 1315/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6672 - acc: 0.7153 - val_loss: 0.7821 - val_acc: 0.6722
Epoch 1316/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6665 - acc: 0.7181 - val_loss: 0.7804 - val_acc: 0.6667
Epoch 1317/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6623 - acc: 0.7194 - val_loss: 0.7784 - val_acc: 0.6833
Epoch 1318/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6595 - acc: 0.7208 - val_loss: 0.7723 - val_acc: 0.6611
Epoch 1319/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6585 - acc: 0.7306 - val_loss: 0.7811 - val_acc: 0.6833
Epoch 1320/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6589 - acc: 0.7292 - val_loss: 0.7728 - val_acc: 0.6778
Epoch 1321/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6594 - acc: 0.7264 - val_loss: 0.7786 - val_acc: 0.6667
Epoch 1322/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6595 - acc: 0.7278 - val_loss: 0.7757 - val_acc: 0.6778
Epoch 1323/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6597 - acc: 0.7264 - val_loss: 0.7733 - val_acc: 0.6667
Epoch 1324/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6598 - acc: 0.7194 - val_loss: 0.7819 - val_acc: 0.6833
Epoch 1325/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6605 - acc: 0.7236 - val_loss: 0.7722 - val_acc: 0.6667
Epoch 1326/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6605 - acc: 0.7278 - val_loss: 0.7847 - val_acc: 0.6833
Epoch 1327/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6603 - acc: 0.7236 - val_loss: 0.7732 - val_acc: 0.6667
Epoch 1328/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6588 - acc: 0.7250 - val_loss: 0.7791 - val_acc: 0.6833
Epoch 1329/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6576 - acc: 0.7236 - val_loss: 0.7746 - val_acc: 0.6778
Epoch 1330/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6568 - acc: 0.7264 - val_loss: 0.7723 - val_acc: 0.6722
Epoch 1331/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6567 - acc: 0.7319 - val_loss: 0.7778 - val_acc: 0.6778
Epoch 1332/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6570 - acc: 0.7278 - val_loss: 0.7707 - val_acc: 0.6667
Epoch 1333/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6572 - acc: 0.7319 - val_loss: 0.7794 - val_acc: 0.6833
Epoch 1334/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6572 - acc: 0.7264 - val_loss: 0.7724 - val_acc: 0.6611
Epoch 1335/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6569 - acc: 0.7292 - val_loss: 0.7773 - val_acc: 0.6833
Epoch 1336/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6569 - acc: 0.7236 - val_loss: 0.7746 - val_acc: 0.6722
Epoch 1337/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6570 - acc: 0.7278 - val_loss: 0.7747 - val_acc: 0.6778
Epoch 1338/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6577 - acc: 0.7250 - val_loss: 0.7771 - val_acc: 0.6722
Epoch 1339/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6585 - acc: 0.7208 - val_loss: 0.7760 - val_acc: 0.6778
Epoch 1340/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6599 - acc: 0.7222 - val_loss: 0.7799 - val_acc: 0.6667
Epoch 1341/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6610 - acc: 0.7181 - val_loss: 0.7817 - val_acc: 0.6667
Epoch 1342/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6638 - acc: 0.7236 - val_loss: 0.7821 - val_acc: 0.6611
Epoch 1343/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6653 - acc: 0.7181 - val_loss: 0.7898 - val_acc: 0.6722
Epoch 1344/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6695 - acc: 0.7222 - val_loss: 0.7832 - val_acc: 0.6667
Epoch 1345/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6696 - acc: 0.7194 - val_loss: 0.7933 - val_acc: 0.6667
Epoch 1346/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6710 - acc: 0.7222 - val_loss: 0.7802 - val_acc: 0.6611
Epoch 1347/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6660 - acc: 0.7194 - val_loss: 0.7847 - val_acc: 0.6778
Epoch 1348/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6613 - acc: 0.7222 - val_loss: 0.7757 - val_acc: 0.6611
Epoch 1349/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6566 - acc: 0.7292 - val_loss: 0.7749 - val_acc: 0.6722
Epoch 1350/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6550 - acc: 0.7264 - val_loss: 0.7781 - val_acc: 0.6833
Epoch 1351/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6564 - acc: 0.7264 - val_loss: 0.7744 - val_acc: 0.6667
Epoch 1352/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6590 - acc: 0.7208 - val_loss: 0.7837 - val_acc: 0.6778
Epoch 1353/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6618 - acc: 0.7264 - val_loss: 0.7787 - val_acc: 0.6611
Epoch 1354/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6622 - acc: 0.7208 - val_loss: 0.7823 - val_acc: 0.6722
Epoch 1355/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6624 - acc: 0.7278 - val_loss: 0.7809 - val_acc: 0.6722
Epoch 1356/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6601 - acc: 0.7181 - val_loss: 0.7738 - val_acc: 0.6722
Epoch 1357/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6587 - acc: 0.7236 - val_loss: 0.7797 - val_acc: 0.6778
Epoch 1358/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6571 - acc: 0.7264 - val_loss: 0.7673 - val_acc: 0.6556
Epoch 1359/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6560 - acc: 0.7389 - val_loss: 0.7771 - val_acc: 0.6833
Epoch 1360/2000
720/720 [==============================] - 0s 36us/step - loss: 0.6557 - acc: 0.7292 - val_loss: 0.7697 - val_acc: 0.6722
Epoch 1361/2000
720/720 [==============================] - 0s 29us/step - loss: 0.6557 - acc: 0.7250 - val_loss: 0.7768 - val_acc: 0.6833
Epoch 1362/2000
720/720 [==============================] - 0s 39us/step - loss: 0.6564 - acc: 0.7236 - val_loss: 0.7768 - val_acc: 0.6778
Epoch 1363/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6573 - acc: 0.7194 - val_loss: 0.7763 - val_acc: 0.6722
Epoch 1364/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6588 - acc: 0.7236 - val_loss: 0.7822 - val_acc: 0.6778
Epoch 1365/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6592 - acc: 0.7153 - val_loss: 0.7742 - val_acc: 0.6778
Epoch 1366/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6602 - acc: 0.7208 - val_loss: 0.7823 - val_acc: 0.6722
Epoch 1367/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6590 - acc: 0.7167 - val_loss: 0.7722 - val_acc: 0.6722
Epoch 1368/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6578 - acc: 0.7236 - val_loss: 0.7774 - val_acc: 0.6667
Epoch 1369/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6556 - acc: 0.7264 - val_loss: 0.7729 - val_acc: 0.6833
Epoch 1370/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6541 - acc: 0.7236 - val_loss: 0.7721 - val_acc: 0.6667
Epoch 1371/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6534 - acc: 0.7292 - val_loss: 0.7762 - val_acc: 0.6778
Epoch 1372/2000
720/720 [==============================] - 0s 36us/step - loss: 0.6535 - acc: 0.7292 - val_loss: 0.7701 - val_acc: 0.6667
Epoch 1373/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6541 - acc: 0.7319 - val_loss: 0.7785 - val_acc: 0.6778
Epoch 1374/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6547 - acc: 0.7306 - val_loss: 0.7709 - val_acc: 0.6722
Epoch 1375/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6551 - acc: 0.7319 - val_loss: 0.7781 - val_acc: 0.6667
Epoch 1376/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6552 - acc: 0.7264 - val_loss: 0.7742 - val_acc: 0.6778
Epoch 1377/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6557 - acc: 0.7278 - val_loss: 0.7760 - val_acc: 0.6778
Epoch 1378/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6560 - acc: 0.7167 - val_loss: 0.7791 - val_acc: 0.6778
Epoch 1379/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6573 - acc: 0.7250 - val_loss: 0.7739 - val_acc: 0.6611
Epoch 1380/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6585 - acc: 0.7236 - val_loss: 0.7856 - val_acc: 0.6778
Epoch 1381/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6610 - acc: 0.7236 - val_loss: 0.7740 - val_acc: 0.6667
Epoch 1382/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6618 - acc: 0.7194 - val_loss: 0.7892 - val_acc: 0.6778
Epoch 1383/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6632 - acc: 0.7181 - val_loss: 0.7751 - val_acc: 0.6722
Epoch 1384/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6610 - acc: 0.7236 - val_loss: 0.7826 - val_acc: 0.6778
Epoch 1385/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6589 - acc: 0.7264 - val_loss: 0.7765 - val_acc: 0.6778
Epoch 1386/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6557 - acc: 0.7222 - val_loss: 0.7724 - val_acc: 0.6722
Epoch 1387/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6544 - acc: 0.7250 - val_loss: 0.7807 - val_acc: 0.6778
Epoch 1388/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6542 - acc: 0.7306 - val_loss: 0.7682 - val_acc: 0.6556
Epoch 1389/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6544 - acc: 0.7375 - val_loss: 0.7830 - val_acc: 0.6833
Epoch 1390/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6549 - acc: 0.7306 - val_loss: 0.7686 - val_acc: 0.6722
Epoch 1391/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6540 - acc: 0.7306 - val_loss: 0.7785 - val_acc: 0.6833
Epoch 1392/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6533 - acc: 0.7278 - val_loss: 0.7709 - val_acc: 0.6778
Epoch 1393/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6527 - acc: 0.7236 - val_loss: 0.7717 - val_acc: 0.6833
Epoch 1394/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6530 - acc: 0.7292 - val_loss: 0.7759 - val_acc: 0.6722
Epoch 1395/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6540 - acc: 0.7236 - val_loss: 0.7695 - val_acc: 0.6722
Epoch 1396/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6557 - acc: 0.7264 - val_loss: 0.7810 - val_acc: 0.6722
Epoch 1397/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6566 - acc: 0.7194 - val_loss: 0.7719 - val_acc: 0.6778
Epoch 1398/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6577 - acc: 0.7236 - val_loss: 0.7803 - val_acc: 0.6778
Epoch 1399/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6571 - acc: 0.7153 - val_loss: 0.7758 - val_acc: 0.6722
Epoch 1400/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6576 - acc: 0.7292 - val_loss: 0.7755 - val_acc: 0.6722
Epoch 1401/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6570 - acc: 0.7222 - val_loss: 0.7811 - val_acc: 0.6778
Epoch 1402/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6580 - acc: 0.7278 - val_loss: 0.7726 - val_acc: 0.6667
Epoch 1403/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6577 - acc: 0.7222 - val_loss: 0.7844 - val_acc: 0.6833
Epoch 1404/2000
720/720 [==============================] - 0s 39us/step - loss: 0.6577 - acc: 0.7222 - val_loss: 0.7721 - val_acc: 0.6889
Epoch 1405/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6556 - acc: 0.7222 - val_loss: 0.7790 - val_acc: 0.6833
Epoch 1406/2000
720/720 [==============================] - 0s 32us/step - loss: 0.6536 - acc: 0.7264 - val_loss: 0.7736 - val_acc: 0.6722
Epoch 1407/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6517 - acc: 0.7250 - val_loss: 0.7707 - val_acc: 0.6778
Epoch 1408/2000
720/720 [==============================] - 0s 42us/step - loss: 0.6511 - acc: 0.7319 - val_loss: 0.7775 - val_acc: 0.6833
Epoch 1409/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6514 - acc: 0.7306 - val_loss: 0.7674 - val_acc: 0.6611
Epoch 1410/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6517 - acc: 0.7333 - val_loss: 0.7789 - val_acc: 0.6778
Epoch 1411/2000
720/720 [==============================] - 0s 29us/step - loss: 0.6518 - acc: 0.7306 - val_loss: 0.7677 - val_acc: 0.6722
Epoch 1412/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6511 - acc: 0.7319 - val_loss: 0.7744 - val_acc: 0.6778
Epoch 1413/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6505 - acc: 0.7306 - val_loss: 0.7695 - val_acc: 0.6667
Epoch 1414/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6502 - acc: 0.7250 - val_loss: 0.7689 - val_acc: 0.6778
Epoch 1415/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6504 - acc: 0.7347 - val_loss: 0.7731 - val_acc: 0.6667
Epoch 1416/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6511 - acc: 0.7250 - val_loss: 0.7677 - val_acc: 0.6722
Epoch 1417/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6521 - acc: 0.7347 - val_loss: 0.7771 - val_acc: 0.6778
Epoch 1418/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6530 - acc: 0.7208 - val_loss: 0.7714 - val_acc: 0.6722
Epoch 1419/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6546 - acc: 0.7278 - val_loss: 0.7792 - val_acc: 0.6778
Epoch 1420/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6559 - acc: 0.7167 - val_loss: 0.7791 - val_acc: 0.6667
Epoch 1421/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6598 - acc: 0.7222 - val_loss: 0.7812 - val_acc: 0.6722
Epoch 1422/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6623 - acc: 0.7167 - val_loss: 0.7911 - val_acc: 0.6611
Epoch 1423/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6693 - acc: 0.7208 - val_loss: 0.7842 - val_acc: 0.6667
Epoch 1424/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6687 - acc: 0.7111 - val_loss: 0.7942 - val_acc: 0.6611
Epoch 1425/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6695 - acc: 0.7236 - val_loss: 0.7794 - val_acc: 0.6722
Epoch 1426/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6600 - acc: 0.7222 - val_loss: 0.7776 - val_acc: 0.6833
Epoch 1427/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6526 - acc: 0.7292 - val_loss: 0.7751 - val_acc: 0.6722
Epoch 1428/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6492 - acc: 0.7292 - val_loss: 0.7702 - val_acc: 0.6833
Epoch 1429/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6512 - acc: 0.7264 - val_loss: 0.7814 - val_acc: 0.6778
Epoch 1430/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6559 - acc: 0.7278 - val_loss: 0.7764 - val_acc: 0.6778
Epoch 1431/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6580 - acc: 0.7208 - val_loss: 0.7829 - val_acc: 0.6667
Epoch 1432/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6592 - acc: 0.7236 - val_loss: 0.7817 - val_acc: 0.6778
Epoch 1433/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6562 - acc: 0.7181 - val_loss: 0.7726 - val_acc: 0.6778
Epoch 1434/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6549 - acc: 0.7194 - val_loss: 0.7822 - val_acc: 0.6833
Epoch 1435/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6530 - acc: 0.7236 - val_loss: 0.7638 - val_acc: 0.6667
Epoch 1436/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6514 - acc: 0.7389 - val_loss: 0.7757 - val_acc: 0.6778
Epoch 1437/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6508 - acc: 0.7292 - val_loss: 0.7658 - val_acc: 0.6889
Epoch 1438/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6505 - acc: 0.7278 - val_loss: 0.7715 - val_acc: 0.6833
Epoch 1439/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6515 - acc: 0.7292 - val_loss: 0.7761 - val_acc: 0.6778
Epoch 1440/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6524 - acc: 0.7208 - val_loss: 0.7700 - val_acc: 0.6778
Epoch 1441/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6538 - acc: 0.7264 - val_loss: 0.7806 - val_acc: 0.6722
Epoch 1442/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6531 - acc: 0.7208 - val_loss: 0.7673 - val_acc: 0.6722
Epoch 1443/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6517 - acc: 0.7347 - val_loss: 0.7747 - val_acc: 0.6722
Epoch 1444/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6493 - acc: 0.7292 - val_loss: 0.7681 - val_acc: 0.6833
Epoch 1445/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6478 - acc: 0.7347 - val_loss: 0.7687 - val_acc: 0.6778
Epoch 1446/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6474 - acc: 0.7306 - val_loss: 0.7743 - val_acc: 0.6833
Epoch 1447/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6481 - acc: 0.7306 - val_loss: 0.7670 - val_acc: 0.6667
Epoch 1448/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6491 - acc: 0.7361 - val_loss: 0.7759 - val_acc: 0.6722
Epoch 1449/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6496 - acc: 0.7250 - val_loss: 0.7676 - val_acc: 0.6667
Epoch 1450/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6497 - acc: 0.7319 - val_loss: 0.7727 - val_acc: 0.6833
Epoch 1451/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6492 - acc: 0.7208 - val_loss: 0.7714 - val_acc: 0.6833
Epoch 1452/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6492 - acc: 0.7292 - val_loss: 0.7697 - val_acc: 0.6778
Epoch 1453/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6492 - acc: 0.7236 - val_loss: 0.7765 - val_acc: 0.6833
Epoch 1454/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6497 - acc: 0.7236 - val_loss: 0.7683 - val_acc: 0.6889
Epoch 1455/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6497 - acc: 0.7250 - val_loss: 0.7768 - val_acc: 0.6833
Epoch 1456/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6497 - acc: 0.7292 - val_loss: 0.7676 - val_acc: 0.6778
Epoch 1457/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6491 - acc: 0.7250 - val_loss: 0.7728 - val_acc: 0.6833
Epoch 1458/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6486 - acc: 0.7292 - val_loss: 0.7697 - val_acc: 0.6833
Epoch 1459/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6481 - acc: 0.7236 - val_loss: 0.7690 - val_acc: 0.6833
Epoch 1460/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6482 - acc: 0.7319 - val_loss: 0.7731 - val_acc: 0.6833
Epoch 1461/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6484 - acc: 0.7236 - val_loss: 0.7677 - val_acc: 0.6722
Epoch 1462/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6488 - acc: 0.7347 - val_loss: 0.7745 - val_acc: 0.6833
Epoch 1463/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6489 - acc: 0.7236 - val_loss: 0.7683 - val_acc: 0.6722
Epoch 1464/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6491 - acc: 0.7333 - val_loss: 0.7729 - val_acc: 0.6833
Epoch 1465/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6489 - acc: 0.7250 - val_loss: 0.7715 - val_acc: 0.6778
Epoch 1466/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6494 - acc: 0.7306 - val_loss: 0.7709 - val_acc: 0.6778
Epoch 1467/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6498 - acc: 0.7222 - val_loss: 0.7762 - val_acc: 0.6778
Epoch 1468/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6514 - acc: 0.7306 - val_loss: 0.7708 - val_acc: 0.6778
Epoch 1469/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6525 - acc: 0.7208 - val_loss: 0.7810 - val_acc: 0.6778
Epoch 1470/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6549 - acc: 0.7264 - val_loss: 0.7736 - val_acc: 0.6778
Epoch 1471/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6552 - acc: 0.7222 - val_loss: 0.7814 - val_acc: 0.6722
Epoch 1472/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6566 - acc: 0.7250 - val_loss: 0.7768 - val_acc: 0.6833
Epoch 1473/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6545 - acc: 0.7236 - val_loss: 0.7748 - val_acc: 0.6722
Epoch 1474/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6537 - acc: 0.7236 - val_loss: 0.7783 - val_acc: 0.6833
Epoch 1475/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6509 - acc: 0.7222 - val_loss: 0.7665 - val_acc: 0.6722
Epoch 1476/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6495 - acc: 0.7306 - val_loss: 0.7770 - val_acc: 0.6833
Epoch 1477/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6479 - acc: 0.7278 - val_loss: 0.7638 - val_acc: 0.6722
Epoch 1478/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6466 - acc: 0.7389 - val_loss: 0.7733 - val_acc: 0.6778
Epoch 1479/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6460 - acc: 0.7333 - val_loss: 0.7670 - val_acc: 0.6889
Epoch 1480/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6459 - acc: 0.7278 - val_loss: 0.7705 - val_acc: 0.6833
Epoch 1481/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6467 - acc: 0.7306 - val_loss: 0.7728 - val_acc: 0.6833
Epoch 1482/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6481 - acc: 0.7250 - val_loss: 0.7697 - val_acc: 0.6722
Epoch 1483/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6504 - acc: 0.7278 - val_loss: 0.7768 - val_acc: 0.6778
Epoch 1484/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6515 - acc: 0.7194 - val_loss: 0.7713 - val_acc: 0.6667
Epoch 1485/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6536 - acc: 0.7278 - val_loss: 0.7759 - val_acc: 0.6778
Epoch 1486/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6525 - acc: 0.7181 - val_loss: 0.7735 - val_acc: 0.6722
Epoch 1487/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6525 - acc: 0.7292 - val_loss: 0.7706 - val_acc: 0.6833
Epoch 1488/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6502 - acc: 0.7236 - val_loss: 0.7753 - val_acc: 0.6833
Epoch 1489/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6488 - acc: 0.7278 - val_loss: 0.7657 - val_acc: 0.6889
Epoch 1490/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6470 - acc: 0.7333 - val_loss: 0.7748 - val_acc: 0.6778
Epoch 1491/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6459 - acc: 0.7319 - val_loss: 0.7645 - val_acc: 0.6778
Epoch 1492/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6448 - acc: 0.7306 - val_loss: 0.7717 - val_acc: 0.6833
Epoch 1493/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6444 - acc: 0.7278 - val_loss: 0.7677 - val_acc: 0.6778
Epoch 1494/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6447 - acc: 0.7375 - val_loss: 0.7694 - val_acc: 0.6889
Epoch 1495/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6456 - acc: 0.7236 - val_loss: 0.7734 - val_acc: 0.6833
Epoch 1496/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6472 - acc: 0.7306 - val_loss: 0.7695 - val_acc: 0.6833
Epoch 1497/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6486 - acc: 0.7236 - val_loss: 0.7778 - val_acc: 0.6778
Epoch 1498/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6508 - acc: 0.7292 - val_loss: 0.7703 - val_acc: 0.6778
Epoch 1499/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6513 - acc: 0.7222 - val_loss: 0.7774 - val_acc: 0.6778
Epoch 1500/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6524 - acc: 0.7264 - val_loss: 0.7709 - val_acc: 0.6778
Epoch 1501/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6508 - acc: 0.7250 - val_loss: 0.7718 - val_acc: 0.6778
Epoch 1502/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6499 - acc: 0.7292 - val_loss: 0.7717 - val_acc: 0.6889
Epoch 1503/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6474 - acc: 0.7236 - val_loss: 0.7661 - val_acc: 0.6778
Epoch 1504/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6461 - acc: 0.7319 - val_loss: 0.7728 - val_acc: 0.6722
Epoch 1505/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6447 - acc: 0.7264 - val_loss: 0.7643 - val_acc: 0.6833
Epoch 1506/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6439 - acc: 0.7361 - val_loss: 0.7722 - val_acc: 0.6833
Epoch 1507/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6435 - acc: 0.7319 - val_loss: 0.7652 - val_acc: 0.6889
Epoch 1508/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6434 - acc: 0.7319 - val_loss: 0.7697 - val_acc: 0.6778
Epoch 1509/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6436 - acc: 0.7306 - val_loss: 0.7673 - val_acc: 0.6833
Epoch 1510/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6441 - acc: 0.7236 - val_loss: 0.7677 - val_acc: 0.6833
Epoch 1511/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6453 - acc: 0.7319 - val_loss: 0.7711 - val_acc: 0.6833
Epoch 1512/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6466 - acc: 0.7250 - val_loss: 0.7687 - val_acc: 0.6722
Epoch 1513/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6490 - acc: 0.7292 - val_loss: 0.7753 - val_acc: 0.6833
Epoch 1514/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6501 - acc: 0.7181 - val_loss: 0.7722 - val_acc: 0.6667
Epoch 1515/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6529 - acc: 0.7264 - val_loss: 0.7761 - val_acc: 0.6778
Epoch 1516/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6518 - acc: 0.7194 - val_loss: 0.7742 - val_acc: 0.6667
Epoch 1517/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6523 - acc: 0.7250 - val_loss: 0.7719 - val_acc: 0.6778
Epoch 1518/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6492 - acc: 0.7250 - val_loss: 0.7737 - val_acc: 0.6833
Epoch 1519/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6474 - acc: 0.7292 - val_loss: 0.7667 - val_acc: 0.6889
Epoch 1520/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6449 - acc: 0.7264 - val_loss: 0.7726 - val_acc: 0.6778
Epoch 1521/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6434 - acc: 0.7278 - val_loss: 0.7644 - val_acc: 0.6889
Epoch 1522/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6424 - acc: 0.7306 - val_loss: 0.7709 - val_acc: 0.6833
Epoch 1523/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6422 - acc: 0.7292 - val_loss: 0.7655 - val_acc: 0.6833
Epoch 1524/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6426 - acc: 0.7361 - val_loss: 0.7695 - val_acc: 0.6889
Epoch 1525/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6434 - acc: 0.7236 - val_loss: 0.7689 - val_acc: 0.6833
Epoch 1526/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6450 - acc: 0.7306 - val_loss: 0.7693 - val_acc: 0.6778
Epoch 1527/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6463 - acc: 0.7278 - val_loss: 0.7737 - val_acc: 0.6778
Epoch 1528/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6489 - acc: 0.7278 - val_loss: 0.7698 - val_acc: 0.6778
Epoch 1529/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6498 - acc: 0.7264 - val_loss: 0.7772 - val_acc: 0.6778
Epoch 1530/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6519 - acc: 0.7278 - val_loss: 0.7697 - val_acc: 0.6778
Epoch 1531/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6503 - acc: 0.7278 - val_loss: 0.7748 - val_acc: 0.6778
Epoch 1532/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6492 - acc: 0.7278 - val_loss: 0.7682 - val_acc: 0.6889
Epoch 1533/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6455 - acc: 0.7292 - val_loss: 0.7678 - val_acc: 0.6833
Epoch 1534/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6430 - acc: 0.7333 - val_loss: 0.7685 - val_acc: 0.6778
Epoch 1535/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6414 - acc: 0.7278 - val_loss: 0.7638 - val_acc: 0.6833
Epoch 1536/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6411 - acc: 0.7361 - val_loss: 0.7712 - val_acc: 0.6778
Epoch 1537/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6419 - acc: 0.7306 - val_loss: 0.7645 - val_acc: 0.6889
Epoch 1538/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6429 - acc: 0.7306 - val_loss: 0.7734 - val_acc: 0.6833
Epoch 1539/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6442 - acc: 0.7292 - val_loss: 0.7668 - val_acc: 0.6833
Epoch 1540/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6450 - acc: 0.7264 - val_loss: 0.7723 - val_acc: 0.6778
Epoch 1541/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6463 - acc: 0.7292 - val_loss: 0.7700 - val_acc: 0.6778
Epoch 1542/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6466 - acc: 0.7264 - val_loss: 0.7690 - val_acc: 0.6722
Epoch 1543/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6481 - acc: 0.7306 - val_loss: 0.7741 - val_acc: 0.6833
Epoch 1544/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6475 - acc: 0.7194 - val_loss: 0.7656 - val_acc: 0.6778
Epoch 1545/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6482 - acc: 0.7250 - val_loss: 0.7767 - val_acc: 0.6889
Epoch 1546/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6465 - acc: 0.7222 - val_loss: 0.7629 - val_acc: 0.6722
Epoch 1547/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6451 - acc: 0.7333 - val_loss: 0.7741 - val_acc: 0.6778
Epoch 1548/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6430 - acc: 0.7236 - val_loss: 0.7623 - val_acc: 0.6667
Epoch 1549/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6413 - acc: 0.7361 - val_loss: 0.7689 - val_acc: 0.6889
Epoch 1550/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6402 - acc: 0.7333 - val_loss: 0.7645 - val_acc: 0.6889
Epoch 1551/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6398 - acc: 0.7319 - val_loss: 0.7653 - val_acc: 0.6833
Epoch 1552/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6403 - acc: 0.7389 - val_loss: 0.7688 - val_acc: 0.6889
Epoch 1553/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6412 - acc: 0.7250 - val_loss: 0.7648 - val_acc: 0.6722
Epoch 1554/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6429 - acc: 0.7361 - val_loss: 0.7727 - val_acc: 0.6889
Epoch 1555/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6442 - acc: 0.7250 - val_loss: 0.7670 - val_acc: 0.6722
Epoch 1556/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6466 - acc: 0.7292 - val_loss: 0.7740 - val_acc: 0.6833
Epoch 1557/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6471 - acc: 0.7167 - val_loss: 0.7710 - val_acc: 0.6667
Epoch 1558/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6492 - acc: 0.7278 - val_loss: 0.7716 - val_acc: 0.6778
Epoch 1559/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6481 - acc: 0.7236 - val_loss: 0.7750 - val_acc: 0.6778
Epoch 1560/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6487 - acc: 0.7278 - val_loss: 0.7674 - val_acc: 0.6778
Epoch 1561/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6466 - acc: 0.7264 - val_loss: 0.7773 - val_acc: 0.6833
Epoch 1562/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6457 - acc: 0.7264 - val_loss: 0.7639 - val_acc: 0.6889
Epoch 1563/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6433 - acc: 0.7347 - val_loss: 0.7747 - val_acc: 0.6778
Epoch 1564/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6416 - acc: 0.7264 - val_loss: 0.7626 - val_acc: 0.6889
Epoch 1565/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6398 - acc: 0.7319 - val_loss: 0.7686 - val_acc: 0.7000
Epoch 1566/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6390 - acc: 0.7319 - val_loss: 0.7650 - val_acc: 0.6833
Epoch 1567/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6393 - acc: 0.7389 - val_loss: 0.7650 - val_acc: 0.6889
Epoch 1568/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6404 - acc: 0.7236 - val_loss: 0.7702 - val_acc: 0.6833
Epoch 1569/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6422 - acc: 0.7292 - val_loss: 0.7651 - val_acc: 0.6833
Epoch 1570/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6438 - acc: 0.7264 - val_loss: 0.7744 - val_acc: 0.6778
Epoch 1571/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6461 - acc: 0.7292 - val_loss: 0.7668 - val_acc: 0.6778
Epoch 1572/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6464 - acc: 0.7236 - val_loss: 0.7735 - val_acc: 0.6778
Epoch 1573/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6474 - acc: 0.7278 - val_loss: 0.7683 - val_acc: 0.6833
Epoch 1574/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6454 - acc: 0.7292 - val_loss: 0.7672 - val_acc: 0.6778
Epoch 1575/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6444 - acc: 0.7333 - val_loss: 0.7706 - val_acc: 0.6889
Epoch 1576/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6421 - acc: 0.7278 - val_loss: 0.7615 - val_acc: 0.6667
Epoch 1577/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6411 - acc: 0.7389 - val_loss: 0.7732 - val_acc: 0.7000
Epoch 1578/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6404 - acc: 0.7292 - val_loss: 0.7603 - val_acc: 0.6722
Epoch 1579/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6398 - acc: 0.7375 - val_loss: 0.7722 - val_acc: 0.6778
Epoch 1580/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6394 - acc: 0.7333 - val_loss: 0.7613 - val_acc: 0.6889
Epoch 1581/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6388 - acc: 0.7306 - val_loss: 0.7676 - val_acc: 0.6778
Epoch 1582/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6385 - acc: 0.7306 - val_loss: 0.7638 - val_acc: 0.6889
Epoch 1583/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6387 - acc: 0.7236 - val_loss: 0.7633 - val_acc: 0.6833
Epoch 1584/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6395 - acc: 0.7333 - val_loss: 0.7685 - val_acc: 0.6889
Epoch 1585/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6406 - acc: 0.7264 - val_loss: 0.7626 - val_acc: 0.6667
Epoch 1586/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6426 - acc: 0.7292 - val_loss: 0.7734 - val_acc: 0.6889
Epoch 1587/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6437 - acc: 0.7222 - val_loss: 0.7652 - val_acc: 0.6778
Epoch 1588/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6460 - acc: 0.7250 - val_loss: 0.7747 - val_acc: 0.6833
Epoch 1589/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6457 - acc: 0.7194 - val_loss: 0.7687 - val_acc: 0.6778
Epoch 1590/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6471 - acc: 0.7264 - val_loss: 0.7713 - val_acc: 0.6778
Epoch 1591/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6451 - acc: 0.7250 - val_loss: 0.7720 - val_acc: 0.6778
Epoch 1592/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6451 - acc: 0.7306 - val_loss: 0.7667 - val_acc: 0.6833
Epoch 1593/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6432 - acc: 0.7264 - val_loss: 0.7746 - val_acc: 0.6833
Epoch 1594/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6425 - acc: 0.7278 - val_loss: 0.7634 - val_acc: 0.6889
Epoch 1595/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6406 - acc: 0.7347 - val_loss: 0.7725 - val_acc: 0.6778
Epoch 1596/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6392 - acc: 0.7264 - val_loss: 0.7618 - val_acc: 0.6889
Epoch 1597/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6375 - acc: 0.7319 - val_loss: 0.7660 - val_acc: 0.7000
Epoch 1598/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6366 - acc: 0.7333 - val_loss: 0.7634 - val_acc: 0.7000
Epoch 1599/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6365 - acc: 0.7389 - val_loss: 0.7617 - val_acc: 0.6889
Epoch 1600/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6370 - acc: 0.7264 - val_loss: 0.7670 - val_acc: 0.6833
Epoch 1601/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6381 - acc: 0.7306 - val_loss: 0.7613 - val_acc: 0.6889
Epoch 1602/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6391 - acc: 0.7278 - val_loss: 0.7693 - val_acc: 0.6833
Epoch 1603/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6406 - acc: 0.7306 - val_loss: 0.7633 - val_acc: 0.6778
Epoch 1604/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6414 - acc: 0.7250 - val_loss: 0.7695 - val_acc: 0.6778
Epoch 1605/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6432 - acc: 0.7292 - val_loss: 0.7675 - val_acc: 0.6778
Epoch 1606/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6435 - acc: 0.7278 - val_loss: 0.7687 - val_acc: 0.6778
Epoch 1607/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6454 - acc: 0.7319 - val_loss: 0.7729 - val_acc: 0.6833
Epoch 1608/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6444 - acc: 0.7194 - val_loss: 0.7666 - val_acc: 0.6778
Epoch 1609/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6453 - acc: 0.7264 - val_loss: 0.7754 - val_acc: 0.6889
Epoch 1610/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6430 - acc: 0.7236 - val_loss: 0.7630 - val_acc: 0.6722
Epoch 1611/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6418 - acc: 0.7292 - val_loss: 0.7721 - val_acc: 0.6889
Epoch 1612/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6392 - acc: 0.7250 - val_loss: 0.7609 - val_acc: 0.6778
Epoch 1613/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6374 - acc: 0.7347 - val_loss: 0.7659 - val_acc: 0.6833
Epoch 1614/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6359 - acc: 0.7319 - val_loss: 0.7621 - val_acc: 0.6889
Epoch 1615/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6353 - acc: 0.7333 - val_loss: 0.7613 - val_acc: 0.6889
Epoch 1616/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6354 - acc: 0.7389 - val_loss: 0.7654 - val_acc: 0.6833
Epoch 1617/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6360 - acc: 0.7292 - val_loss: 0.7597 - val_acc: 0.6778
Epoch 1618/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6369 - acc: 0.7347 - val_loss: 0.7678 - val_acc: 0.6889
Epoch 1619/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6378 - acc: 0.7278 - val_loss: 0.7610 - val_acc: 0.6722
Epoch 1620/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6391 - acc: 0.7333 - val_loss: 0.7682 - val_acc: 0.6889
Epoch 1621/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6398 - acc: 0.7250 - val_loss: 0.7654 - val_acc: 0.6778
Epoch 1622/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6419 - acc: 0.7347 - val_loss: 0.7678 - val_acc: 0.6778
Epoch 1623/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6426 - acc: 0.7264 - val_loss: 0.7726 - val_acc: 0.6833
Epoch 1624/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6457 - acc: 0.7278 - val_loss: 0.7681 - val_acc: 0.6778
Epoch 1625/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6458 - acc: 0.7250 - val_loss: 0.7788 - val_acc: 0.6778
Epoch 1626/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6479 - acc: 0.7278 - val_loss: 0.7677 - val_acc: 0.6778
Epoch 1627/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6448 - acc: 0.7250 - val_loss: 0.7749 - val_acc: 0.6778
Epoch 1628/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6424 - acc: 0.7319 - val_loss: 0.7651 - val_acc: 0.6889
Epoch 1629/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6379 - acc: 0.7278 - val_loss: 0.7638 - val_acc: 0.6889
Epoch 1630/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6353 - acc: 0.7333 - val_loss: 0.7661 - val_acc: 0.7000
Epoch 1631/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6347 - acc: 0.7319 - val_loss: 0.7591 - val_acc: 0.6889
Epoch 1632/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6356 - acc: 0.7306 - val_loss: 0.7705 - val_acc: 0.6833
Epoch 1633/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6373 - acc: 0.7236 - val_loss: 0.7612 - val_acc: 0.6889
Epoch 1634/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6382 - acc: 0.7347 - val_loss: 0.7706 - val_acc: 0.6889
Epoch 1635/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6394 - acc: 0.7319 - val_loss: 0.7643 - val_acc: 0.6833
Epoch 1636/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6394 - acc: 0.7264 - val_loss: 0.7650 - val_acc: 0.6778
Epoch 1637/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6404 - acc: 0.7347 - val_loss: 0.7684 - val_acc: 0.6889
Epoch 1638/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6402 - acc: 0.7236 - val_loss: 0.7599 - val_acc: 0.6722
Epoch 1639/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6414 - acc: 0.7306 - val_loss: 0.7728 - val_acc: 0.6889
Epoch 1640/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6405 - acc: 0.7236 - val_loss: 0.7585 - val_acc: 0.6667
Epoch 1641/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6398 - acc: 0.7333 - val_loss: 0.7713 - val_acc: 0.6833
Epoch 1642/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6376 - acc: 0.7264 - val_loss: 0.7588 - val_acc: 0.6778
Epoch 1643/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6356 - acc: 0.7333 - val_loss: 0.7644 - val_acc: 0.6833
Epoch 1644/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6340 - acc: 0.7292 - val_loss: 0.7615 - val_acc: 0.6833
Epoch 1645/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6333 - acc: 0.7375 - val_loss: 0.7592 - val_acc: 0.6944
Epoch 1646/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6334 - acc: 0.7389 - val_loss: 0.7661 - val_acc: 0.6889
Epoch 1647/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6340 - acc: 0.7306 - val_loss: 0.7577 - val_acc: 0.6667
Epoch 1648/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6346 - acc: 0.7361 - val_loss: 0.7681 - val_acc: 0.6833
Epoch 1649/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6350 - acc: 0.7333 - val_loss: 0.7582 - val_acc: 0.6778
Epoch 1650/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6354 - acc: 0.7347 - val_loss: 0.7659 - val_acc: 0.6889
Epoch 1651/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6356 - acc: 0.7292 - val_loss: 0.7612 - val_acc: 0.6722
Epoch 1652/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6366 - acc: 0.7333 - val_loss: 0.7639 - val_acc: 0.6889
Epoch 1653/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6375 - acc: 0.7306 - val_loss: 0.7681 - val_acc: 0.6833
Epoch 1654/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6402 - acc: 0.7347 - val_loss: 0.7658 - val_acc: 0.6778
Epoch 1655/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6419 - acc: 0.7250 - val_loss: 0.7768 - val_acc: 0.6778
Epoch 1656/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6462 - acc: 0.7278 - val_loss: 0.7700 - val_acc: 0.6778
Epoch 1657/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6461 - acc: 0.7264 - val_loss: 0.7781 - val_acc: 0.6722
Epoch 1658/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6481 - acc: 0.7278 - val_loss: 0.7718 - val_acc: 0.6778
Epoch 1659/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6433 - acc: 0.7236 - val_loss: 0.7666 - val_acc: 0.6722
Epoch 1660/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6408 - acc: 0.7264 - val_loss: 0.7721 - val_acc: 0.6833
Epoch 1661/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6369 - acc: 0.7264 - val_loss: 0.7567 - val_acc: 0.6611
Epoch 1662/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6355 - acc: 0.7361 - val_loss: 0.7724 - val_acc: 0.6944
Epoch 1663/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6353 - acc: 0.7319 - val_loss: 0.7570 - val_acc: 0.6778
Epoch 1664/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6347 - acc: 0.7319 - val_loss: 0.7680 - val_acc: 0.6833
Epoch 1665/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6349 - acc: 0.7250 - val_loss: 0.7623 - val_acc: 0.6889
Epoch 1666/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6353 - acc: 0.7250 - val_loss: 0.7629 - val_acc: 0.6778
Epoch 1667/2000
720/720 [==============================] - 0s 18us/step - loss: 0.6371 - acc: 0.7333 - val_loss: 0.7693 - val_acc: 0.6889
Epoch 1668/2000
720/720 [==============================] - 0s 46us/step - loss: 0.6385 - acc: 0.7222 - val_loss: 0.7602 - val_acc: 0.6778
Epoch 1669/2000
720/720 [==============================] - 0s 32us/step - loss: 0.6412 - acc: 0.7292 - val_loss: 0.7725 - val_acc: 0.6889
Epoch 1670/2000
720/720 [==============================] - 0s 43us/step - loss: 0.6402 - acc: 0.7236 - val_loss: 0.7596 - val_acc: 0.6778
Epoch 1671/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6396 - acc: 0.7333 - val_loss: 0.7662 - val_acc: 0.6944
Epoch 1672/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6361 - acc: 0.7264 - val_loss: 0.7610 - val_acc: 0.6889
Epoch 1673/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6339 - acc: 0.7361 - val_loss: 0.7584 - val_acc: 0.6889
Epoch 1674/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6325 - acc: 0.7278 - val_loss: 0.7649 - val_acc: 0.6889
Epoch 1675/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6323 - acc: 0.7347 - val_loss: 0.7560 - val_acc: 0.6778
Epoch 1676/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6325 - acc: 0.7319 - val_loss: 0.7664 - val_acc: 0.6889
Epoch 1677/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6327 - acc: 0.7347 - val_loss: 0.7584 - val_acc: 0.6833
Epoch 1678/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6330 - acc: 0.7319 - val_loss: 0.7642 - val_acc: 0.6944
Epoch 1679/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6334 - acc: 0.7264 - val_loss: 0.7636 - val_acc: 0.6944
Epoch 1680/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6348 - acc: 0.7319 - val_loss: 0.7623 - val_acc: 0.6889
Epoch 1681/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6361 - acc: 0.7278 - val_loss: 0.7695 - val_acc: 0.6889
Epoch 1682/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6385 - acc: 0.7375 - val_loss: 0.7627 - val_acc: 0.6778
Epoch 1683/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6389 - acc: 0.7250 - val_loss: 0.7703 - val_acc: 0.6833
Epoch 1684/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6399 - acc: 0.7319 - val_loss: 0.7641 - val_acc: 0.6889
Epoch 1685/2000
720/720 [==============================] - 0s 39us/step - loss: 0.6378 - acc: 0.7278 - val_loss: 0.7634 - val_acc: 0.6778
Epoch 1686/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6368 - acc: 0.7347 - val_loss: 0.7660 - val_acc: 0.6889
Epoch 1687/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6346 - acc: 0.7292 - val_loss: 0.7570 - val_acc: 0.6722
Epoch 1688/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6338 - acc: 0.7333 - val_loss: 0.7673 - val_acc: 0.6833
Epoch 1689/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6327 - acc: 0.7319 - val_loss: 0.7563 - val_acc: 0.6722
Epoch 1690/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6318 - acc: 0.7403 - val_loss: 0.7647 - val_acc: 0.6889
Epoch 1691/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6310 - acc: 0.7347 - val_loss: 0.7580 - val_acc: 0.6944
Epoch 1692/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6304 - acc: 0.7375 - val_loss: 0.7595 - val_acc: 0.6944
Epoch 1693/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6304 - acc: 0.7403 - val_loss: 0.7605 - val_acc: 0.6889
Epoch 1694/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6309 - acc: 0.7264 - val_loss: 0.7559 - val_acc: 0.6889
Epoch 1695/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6319 - acc: 0.7347 - val_loss: 0.7639 - val_acc: 0.6889
Epoch 1696/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6329 - acc: 0.7306 - val_loss: 0.7573 - val_acc: 0.6778
Epoch 1697/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6345 - acc: 0.7333 - val_loss: 0.7664 - val_acc: 0.6944
Epoch 1698/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6355 - acc: 0.7250 - val_loss: 0.7626 - val_acc: 0.6722
Epoch 1699/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6382 - acc: 0.7319 - val_loss: 0.7674 - val_acc: 0.6778
Epoch 1700/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6390 - acc: 0.7236 - val_loss: 0.7700 - val_acc: 0.6722
Epoch 1701/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6428 - acc: 0.7292 - val_loss: 0.7681 - val_acc: 0.6722
Epoch 1702/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6422 - acc: 0.7278 - val_loss: 0.7749 - val_acc: 0.6778
Epoch 1703/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6442 - acc: 0.7292 - val_loss: 0.7671 - val_acc: 0.6833
Epoch 1704/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6399 - acc: 0.7292 - val_loss: 0.7688 - val_acc: 0.6778
Epoch 1705/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6369 - acc: 0.7306 - val_loss: 0.7637 - val_acc: 0.6889
Epoch 1706/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6324 - acc: 0.7292 - val_loss: 0.7585 - val_acc: 0.6889
Epoch 1707/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6301 - acc: 0.7361 - val_loss: 0.7637 - val_acc: 0.7000
Epoch 1708/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6299 - acc: 0.7319 - val_loss: 0.7565 - val_acc: 0.6889
Epoch 1709/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6309 - acc: 0.7347 - val_loss: 0.7661 - val_acc: 0.6889
Epoch 1710/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6326 - acc: 0.7278 - val_loss: 0.7605 - val_acc: 0.6889
Epoch 1711/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6338 - acc: 0.7292 - val_loss: 0.7652 - val_acc: 0.6778
Epoch 1712/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6358 - acc: 0.7319 - val_loss: 0.7647 - val_acc: 0.6833
Epoch 1713/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6363 - acc: 0.7306 - val_loss: 0.7609 - val_acc: 0.6778
Epoch 1714/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6386 - acc: 0.7292 - val_loss: 0.7687 - val_acc: 0.6889
Epoch 1715/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6375 - acc: 0.7222 - val_loss: 0.7570 - val_acc: 0.6611
Epoch 1716/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6376 - acc: 0.7333 - val_loss: 0.7683 - val_acc: 0.6889
Epoch 1717/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6344 - acc: 0.7250 - val_loss: 0.7555 - val_acc: 0.6722
Epoch 1718/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6318 - acc: 0.7361 - val_loss: 0.7622 - val_acc: 0.6889
Epoch 1719/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6295 - acc: 0.7333 - val_loss: 0.7578 - val_acc: 0.6889
Epoch 1720/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6285 - acc: 0.7319 - val_loss: 0.7573 - val_acc: 0.6889
Epoch 1721/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6288 - acc: 0.7389 - val_loss: 0.7631 - val_acc: 0.6889
Epoch 1722/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6299 - acc: 0.7333 - val_loss: 0.7573 - val_acc: 0.6778
Epoch 1723/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6316 - acc: 0.7389 - val_loss: 0.7670 - val_acc: 0.6889
Epoch 1724/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6328 - acc: 0.7278 - val_loss: 0.7601 - val_acc: 0.6778
Epoch 1725/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6349 - acc: 0.7333 - val_loss: 0.7665 - val_acc: 0.6889
Epoch 1726/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6353 - acc: 0.7264 - val_loss: 0.7639 - val_acc: 0.6833
Epoch 1727/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6373 - acc: 0.7333 - val_loss: 0.7633 - val_acc: 0.6889
Epoch 1728/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6361 - acc: 0.7292 - val_loss: 0.7668 - val_acc: 0.6833
Epoch 1729/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6363 - acc: 0.7333 - val_loss: 0.7598 - val_acc: 0.6889
Epoch 1730/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6338 - acc: 0.7306 - val_loss: 0.7653 - val_acc: 0.6778
Epoch 1731/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6319 - acc: 0.7306 - val_loss: 0.7572 - val_acc: 0.6889
Epoch 1732/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6296 - acc: 0.7278 - val_loss: 0.7602 - val_acc: 0.7000
Epoch 1733/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6282 - acc: 0.7319 - val_loss: 0.7576 - val_acc: 0.6944
Epoch 1734/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6276 - acc: 0.7361 - val_loss: 0.7574 - val_acc: 0.6889
Epoch 1735/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6277 - acc: 0.7319 - val_loss: 0.7608 - val_acc: 0.6889
Epoch 1736/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6285 - acc: 0.7375 - val_loss: 0.7576 - val_acc: 0.6889
Epoch 1737/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6295 - acc: 0.7292 - val_loss: 0.7630 - val_acc: 0.6889
Epoch 1738/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6309 - acc: 0.7389 - val_loss: 0.7587 - val_acc: 0.6889
Epoch 1739/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6320 - acc: 0.7292 - val_loss: 0.7629 - val_acc: 0.6889
Epoch 1740/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6340 - acc: 0.7319 - val_loss: 0.7618 - val_acc: 0.6889
Epoch 1741/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6344 - acc: 0.7319 - val_loss: 0.7623 - val_acc: 0.6833
Epoch 1742/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6365 - acc: 0.7333 - val_loss: 0.7666 - val_acc: 0.6889
Epoch 1743/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6354 - acc: 0.7264 - val_loss: 0.7607 - val_acc: 0.6722
Epoch 1744/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6363 - acc: 0.7319 - val_loss: 0.7689 - val_acc: 0.6944
Epoch 1745/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6339 - acc: 0.7222 - val_loss: 0.7574 - val_acc: 0.6667
Epoch 1746/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6329 - acc: 0.7347 - val_loss: 0.7661 - val_acc: 0.6944
Epoch 1747/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6304 - acc: 0.7292 - val_loss: 0.7555 - val_acc: 0.6722
Epoch 1748/2000
720/720 [==============================] - 0s 39us/step - loss: 0.6287 - acc: 0.7375 - val_loss: 0.7606 - val_acc: 0.6944
Epoch 1749/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6273 - acc: 0.7306 - val_loss: 0.7569 - val_acc: 0.6889
Epoch 1750/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6266 - acc: 0.7375 - val_loss: 0.7562 - val_acc: 0.6889
Epoch 1751/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6265 - acc: 0.7375 - val_loss: 0.7595 - val_acc: 0.6833
Epoch 1752/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6269 - acc: 0.7292 - val_loss: 0.7536 - val_acc: 0.6778
Epoch 1753/2000
720/720 [==============================] - 0s 29us/step - loss: 0.6275 - acc: 0.7361 - val_loss: 0.7615 - val_acc: 0.6889
Epoch 1754/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6282 - acc: 0.7333 - val_loss: 0.7538 - val_acc: 0.6778
Epoch 1755/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6293 - acc: 0.7361 - val_loss: 0.7622 - val_acc: 0.6944
Epoch 1756/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6300 - acc: 0.7306 - val_loss: 0.7573 - val_acc: 0.6778
Epoch 1757/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6319 - acc: 0.7347 - val_loss: 0.7630 - val_acc: 0.6889
Epoch 1758/2000
720/720 [==============================] - 0s 22us/step - loss: 0.6330 - acc: 0.7319 - val_loss: 0.7644 - val_acc: 0.6833
Epoch 1759/2000
720/720 [==============================] - 0s 37us/step - loss: 0.6367 - acc: 0.7333 - val_loss: 0.7652 - val_acc: 0.6778
Epoch 1760/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6377 - acc: 0.7292 - val_loss: 0.7740 - val_acc: 0.6722
Epoch 1761/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6422 - acc: 0.7292 - val_loss: 0.7670 - val_acc: 0.6722
Epoch 1762/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6397 - acc: 0.7306 - val_loss: 0.7740 - val_acc: 0.6833
Epoch 1763/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6389 - acc: 0.7333 - val_loss: 0.7634 - val_acc: 0.6889
Epoch 1764/2000
720/720 [==============================] - 0s 21us/step - loss: 0.6325 - acc: 0.7292 - val_loss: 0.7608 - val_acc: 0.6889
Epoch 1765/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6282 - acc: 0.7361 - val_loss: 0.7610 - val_acc: 0.6889
Epoch 1766/2000
720/720 [==============================] - 0s 18us/step - loss: 0.6261 - acc: 0.7278 - val_loss: 0.7537 - val_acc: 0.6889
Epoch 1767/2000
720/720 [==============================] - 0s 56us/step - loss: 0.6268 - acc: 0.7361 - val_loss: 0.7653 - val_acc: 0.6833
Epoch 1768/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6290 - acc: 0.7264 - val_loss: 0.7572 - val_acc: 0.6833
Epoch 1769/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6309 - acc: 0.7347 - val_loss: 0.7678 - val_acc: 0.6889
Epoch 1770/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6332 - acc: 0.7347 - val_loss: 0.7615 - val_acc: 0.6833
Epoch 1771/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6331 - acc: 0.7250 - val_loss: 0.7617 - val_acc: 0.6833
Epoch 1772/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6343 - acc: 0.7319 - val_loss: 0.7651 - val_acc: 0.6944
Epoch 1773/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6329 - acc: 0.7222 - val_loss: 0.7529 - val_acc: 0.6667
Epoch 1774/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6333 - acc: 0.7361 - val_loss: 0.7695 - val_acc: 0.6833
Epoch 1775/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6318 - acc: 0.7278 - val_loss: 0.7506 - val_acc: 0.6556
Epoch 1776/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6300 - acc: 0.7361 - val_loss: 0.7669 - val_acc: 0.6889
Epoch 1777/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6281 - acc: 0.7306 - val_loss: 0.7529 - val_acc: 0.6778
Epoch 1778/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6260 - acc: 0.7361 - val_loss: 0.7586 - val_acc: 0.6889
Epoch 1779/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6252 - acc: 0.7333 - val_loss: 0.7584 - val_acc: 0.6944
Epoch 1780/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6256 - acc: 0.7292 - val_loss: 0.7539 - val_acc: 0.6722
Epoch 1781/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6271 - acc: 0.7361 - val_loss: 0.7656 - val_acc: 0.6889
Epoch 1782/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6286 - acc: 0.7333 - val_loss: 0.7542 - val_acc: 0.6667
Epoch 1783/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6304 - acc: 0.7319 - val_loss: 0.7676 - val_acc: 0.6889
Epoch 1784/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6307 - acc: 0.7264 - val_loss: 0.7566 - val_acc: 0.6722
Epoch 1785/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6319 - acc: 0.7347 - val_loss: 0.7631 - val_acc: 0.6889
Epoch 1786/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6309 - acc: 0.7306 - val_loss: 0.7608 - val_acc: 0.6889
Epoch 1787/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6316 - acc: 0.7347 - val_loss: 0.7587 - val_acc: 0.6889
Epoch 1788/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6303 - acc: 0.7333 - val_loss: 0.7649 - val_acc: 0.6889
Epoch 1789/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6303 - acc: 0.7319 - val_loss: 0.7568 - val_acc: 0.6833
Epoch 1790/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6286 - acc: 0.7333 - val_loss: 0.7632 - val_acc: 0.6889
Epoch 1791/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6274 - acc: 0.7306 - val_loss: 0.7560 - val_acc: 0.6889
Epoch 1792/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6257 - acc: 0.7264 - val_loss: 0.7568 - val_acc: 0.7000
Epoch 1793/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6247 - acc: 0.7403 - val_loss: 0.7579 - val_acc: 0.6889
Epoch 1794/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6242 - acc: 0.7292 - val_loss: 0.7527 - val_acc: 0.6778
Epoch 1795/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6242 - acc: 0.7389 - val_loss: 0.7601 - val_acc: 0.6889
Epoch 1796/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6244 - acc: 0.7319 - val_loss: 0.7515 - val_acc: 0.6833
Epoch 1797/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6243 - acc: 0.7361 - val_loss: 0.7583 - val_acc: 0.6944
Epoch 1798/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6242 - acc: 0.7319 - val_loss: 0.7515 - val_acc: 0.6889
Epoch 1799/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6240 - acc: 0.7375 - val_loss: 0.7543 - val_acc: 0.7000
Epoch 1800/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6239 - acc: 0.7347 - val_loss: 0.7544 - val_acc: 0.6889
Epoch 1801/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6241 - acc: 0.7306 - val_loss: 0.7528 - val_acc: 0.6944
Epoch 1802/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6246 - acc: 0.7403 - val_loss: 0.7589 - val_acc: 0.6944
Epoch 1803/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6254 - acc: 0.7306 - val_loss: 0.7541 - val_acc: 0.6722
Epoch 1804/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6269 - acc: 0.7375 - val_loss: 0.7632 - val_acc: 0.6889
Epoch 1805/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6286 - acc: 0.7292 - val_loss: 0.7588 - val_acc: 0.6833
Epoch 1806/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6327 - acc: 0.7319 - val_loss: 0.7688 - val_acc: 0.6833
Epoch 1807/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6354 - acc: 0.7222 - val_loss: 0.7707 - val_acc: 0.6778
Epoch 1808/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6444 - acc: 0.7181 - val_loss: 0.7754 - val_acc: 0.6722
Epoch 1809/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6439 - acc: 0.7181 - val_loss: 0.7793 - val_acc: 0.6667
Epoch 1810/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6503 - acc: 0.7208 - val_loss: 0.7716 - val_acc: 0.6778
Epoch 1811/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6390 - acc: 0.7264 - val_loss: 0.7646 - val_acc: 0.6833
Epoch 1812/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6320 - acc: 0.7333 - val_loss: 0.7601 - val_acc: 0.6889
Epoch 1813/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6247 - acc: 0.7347 - val_loss: 0.7543 - val_acc: 0.6833
Epoch 1814/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6230 - acc: 0.7333 - val_loss: 0.7591 - val_acc: 0.6889
Epoch 1815/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6260 - acc: 0.7361 - val_loss: 0.7617 - val_acc: 0.6833
Epoch 1816/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6304 - acc: 0.7292 - val_loss: 0.7680 - val_acc: 0.6778
Epoch 1817/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6368 - acc: 0.7319 - val_loss: 0.7686 - val_acc: 0.6722
Epoch 1818/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6361 - acc: 0.7194 - val_loss: 0.7648 - val_acc: 0.6778
Epoch 1819/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6369 - acc: 0.7264 - val_loss: 0.7661 - val_acc: 0.6889
Epoch 1820/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6304 - acc: 0.7236 - val_loss: 0.7491 - val_acc: 0.6722
Epoch 1821/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6266 - acc: 0.7417 - val_loss: 0.7599 - val_acc: 0.6889
Epoch 1822/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6240 - acc: 0.7361 - val_loss: 0.7499 - val_acc: 0.6889
Epoch 1823/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6240 - acc: 0.7458 - val_loss: 0.7586 - val_acc: 0.6944
Epoch 1824/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6260 - acc: 0.7306 - val_loss: 0.7589 - val_acc: 0.6889
Epoch 1825/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6274 - acc: 0.7319 - val_loss: 0.7591 - val_acc: 0.6833
Epoch 1826/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6293 - acc: 0.7292 - val_loss: 0.7640 - val_acc: 0.6944
Epoch 1827/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6281 - acc: 0.7278 - val_loss: 0.7535 - val_acc: 0.6667
Epoch 1828/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6272 - acc: 0.7347 - val_loss: 0.7631 - val_acc: 0.6889
Epoch 1829/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6248 - acc: 0.7333 - val_loss: 0.7518 - val_acc: 0.6722
Epoch 1830/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6229 - acc: 0.7417 - val_loss: 0.7574 - val_acc: 0.6889
Epoch 1831/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6220 - acc: 0.7333 - val_loss: 0.7539 - val_acc: 0.6889
Epoch 1832/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6220 - acc: 0.7319 - val_loss: 0.7531 - val_acc: 0.6889
Epoch 1833/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6229 - acc: 0.7417 - val_loss: 0.7576 - val_acc: 0.6944
Epoch 1834/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6239 - acc: 0.7306 - val_loss: 0.7518 - val_acc: 0.6778
Epoch 1835/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6251 - acc: 0.7403 - val_loss: 0.7610 - val_acc: 0.6944
Epoch 1836/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6251 - acc: 0.7292 - val_loss: 0.7544 - val_acc: 0.6722
Epoch 1837/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6253 - acc: 0.7375 - val_loss: 0.7591 - val_acc: 0.6889
Epoch 1838/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6244 - acc: 0.7306 - val_loss: 0.7558 - val_acc: 0.6889
Epoch 1839/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6241 - acc: 0.7403 - val_loss: 0.7547 - val_acc: 0.6889
Epoch 1840/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6235 - acc: 0.7278 - val_loss: 0.7574 - val_acc: 0.6944
Epoch 1841/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6234 - acc: 0.7347 - val_loss: 0.7518 - val_acc: 0.6889
Epoch 1842/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6230 - acc: 0.7347 - val_loss: 0.7595 - val_acc: 0.6889
Epoch 1843/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6228 - acc: 0.7319 - val_loss: 0.7518 - val_acc: 0.6889
Epoch 1844/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6221 - acc: 0.7375 - val_loss: 0.7570 - val_acc: 0.6944
Epoch 1845/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6216 - acc: 0.7306 - val_loss: 0.7522 - val_acc: 0.6889
Epoch 1846/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6211 - acc: 0.7375 - val_loss: 0.7535 - val_acc: 0.6889
Epoch 1847/2000
720/720 [==============================] - 0s 25us/step - loss: 0.6208 - acc: 0.7417 - val_loss: 0.7535 - val_acc: 0.7000
Epoch 1848/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6206 - acc: 0.7319 - val_loss: 0.7514 - val_acc: 0.6833
Epoch 1849/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6206 - acc: 0.7403 - val_loss: 0.7556 - val_acc: 0.6944
Epoch 1850/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6206 - acc: 0.7347 - val_loss: 0.7502 - val_acc: 0.6833
Epoch 1851/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6206 - acc: 0.7389 - val_loss: 0.7554 - val_acc: 0.6889
Epoch 1852/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6206 - acc: 0.7319 - val_loss: 0.7494 - val_acc: 0.6889
Epoch 1853/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6205 - acc: 0.7375 - val_loss: 0.7551 - val_acc: 0.6889
Epoch 1854/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6204 - acc: 0.7347 - val_loss: 0.7500 - val_acc: 0.6833
Epoch 1855/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6203 - acc: 0.7403 - val_loss: 0.7549 - val_acc: 0.6944
Epoch 1856/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6201 - acc: 0.7347 - val_loss: 0.7516 - val_acc: 0.6833
Epoch 1857/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6200 - acc: 0.7417 - val_loss: 0.7537 - val_acc: 0.6944
Epoch 1858/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6200 - acc: 0.7306 - val_loss: 0.7518 - val_acc: 0.6833
Epoch 1859/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6200 - acc: 0.7431 - val_loss: 0.7527 - val_acc: 0.6889
Epoch 1860/2000
720/720 [==============================] - 0s 24us/step - loss: 0.6201 - acc: 0.7306 - val_loss: 0.7528 - val_acc: 0.6944
Epoch 1861/2000
720/720 [==============================] - 0s 26us/step - loss: 0.6205 - acc: 0.7389 - val_loss: 0.7533 - val_acc: 0.6889
Epoch 1862/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6212 - acc: 0.7292 - val_loss: 0.7558 - val_acc: 0.6944
Epoch 1863/2000
720/720 [==============================] - 0s 19us/step - loss: 0.6231 - acc: 0.7403 - val_loss: 0.7580 - val_acc: 0.6833
Epoch 1864/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6261 - acc: 0.7319 - val_loss: 0.7654 - val_acc: 0.6889
Epoch 1865/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6342 - acc: 0.7292 - val_loss: 0.7722 - val_acc: 0.6833
Epoch 1866/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6415 - acc: 0.7236 - val_loss: 0.7912 - val_acc: 0.6611
Epoch 1867/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6638 - acc: 0.7139 - val_loss: 0.7883 - val_acc: 0.6667
Epoch 1868/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6554 - acc: 0.7042 - val_loss: 0.7830 - val_acc: 0.6556
Epoch 1869/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6578 - acc: 0.7181 - val_loss: 0.7815 - val_acc: 0.6833
Epoch 1870/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6348 - acc: 0.7181 - val_loss: 0.7488 - val_acc: 0.6611
Epoch 1871/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6266 - acc: 0.7361 - val_loss: 0.7796 - val_acc: 0.6722
Epoch 1872/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6304 - acc: 0.7264 - val_loss: 0.7611 - val_acc: 0.6833
Epoch 1873/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6349 - acc: 0.7375 - val_loss: 0.7807 - val_acc: 0.6778
Epoch 1874/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6438 - acc: 0.7250 - val_loss: 0.7744 - val_acc: 0.6778
Epoch 1875/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6345 - acc: 0.7292 - val_loss: 0.7622 - val_acc: 0.6556
Epoch 1876/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6316 - acc: 0.7333 - val_loss: 0.7761 - val_acc: 0.6833
Epoch 1877/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6292 - acc: 0.7264 - val_loss: 0.7419 - val_acc: 0.6778
Epoch 1878/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6261 - acc: 0.7389 - val_loss: 0.7644 - val_acc: 0.6889
Epoch 1879/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6243 - acc: 0.7278 - val_loss: 0.7574 - val_acc: 0.6889
Epoch 1880/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6231 - acc: 0.7306 - val_loss: 0.7503 - val_acc: 0.6722
Epoch 1881/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6264 - acc: 0.7417 - val_loss: 0.7743 - val_acc: 0.6778
Epoch 1882/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6282 - acc: 0.7292 - val_loss: 0.7479 - val_acc: 0.6611
Epoch 1883/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6249 - acc: 0.7306 - val_loss: 0.7535 - val_acc: 0.6889
Epoch 1884/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6203 - acc: 0.7375 - val_loss: 0.7506 - val_acc: 0.7000
Epoch 1885/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6196 - acc: 0.7333 - val_loss: 0.7500 - val_acc: 0.6556
Epoch 1886/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6228 - acc: 0.7333 - val_loss: 0.7708 - val_acc: 0.6778
Epoch 1887/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6247 - acc: 0.7306 - val_loss: 0.7514 - val_acc: 0.6722
Epoch 1888/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6230 - acc: 0.7361 - val_loss: 0.7567 - val_acc: 0.6889
Epoch 1889/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6202 - acc: 0.7333 - val_loss: 0.7582 - val_acc: 0.6889
Epoch 1890/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6202 - acc: 0.7319 - val_loss: 0.7451 - val_acc: 0.6889
Epoch 1891/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6204 - acc: 0.7472 - val_loss: 0.7595 - val_acc: 0.6944
Epoch 1892/2000
720/720 [==============================] - 0s 17us/step - loss: 0.6199 - acc: 0.7333 - val_loss: 0.7518 - val_acc: 0.6667
Epoch 1893/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6187 - acc: 0.7347 - val_loss: 0.7536 - val_acc: 0.6889
Epoch 1894/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6192 - acc: 0.7319 - val_loss: 0.7585 - val_acc: 0.6944
Epoch 1895/2000
720/720 [==============================] - 0s 35us/step - loss: 0.6207 - acc: 0.7319 - val_loss: 0.7500 - val_acc: 0.6889
Epoch 1896/2000
720/720 [==============================] - 0s 28us/step - loss: 0.6210 - acc: 0.7389 - val_loss: 0.7562 - val_acc: 0.6944
Epoch 1897/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6208 - acc: 0.7389 - val_loss: 0.7525 - val_acc: 0.6889
Epoch 1898/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6201 - acc: 0.7292 - val_loss: 0.7496 - val_acc: 0.6833
Epoch 1899/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6203 - acc: 0.7375 - val_loss: 0.7604 - val_acc: 0.6944
Epoch 1900/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6204 - acc: 0.7361 - val_loss: 0.7485 - val_acc: 0.6722
Epoch 1901/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6201 - acc: 0.7389 - val_loss: 0.7555 - val_acc: 0.6944
Epoch 1902/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6191 - acc: 0.7333 - val_loss: 0.7496 - val_acc: 0.6722
Epoch 1903/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6185 - acc: 0.7417 - val_loss: 0.7502 - val_acc: 0.6889
Epoch 1904/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6183 - acc: 0.7319 - val_loss: 0.7543 - val_acc: 0.6944
Epoch 1905/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6184 - acc: 0.7319 - val_loss: 0.7496 - val_acc: 0.6889
Epoch 1906/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6182 - acc: 0.7389 - val_loss: 0.7542 - val_acc: 0.6944
Epoch 1907/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6178 - acc: 0.7319 - val_loss: 0.7507 - val_acc: 0.6944
Epoch 1908/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6175 - acc: 0.7347 - val_loss: 0.7474 - val_acc: 0.6722
Epoch 1909/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6175 - acc: 0.7347 - val_loss: 0.7533 - val_acc: 0.7000
Epoch 1910/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6177 - acc: 0.7333 - val_loss: 0.7464 - val_acc: 0.6722
Epoch 1911/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6178 - acc: 0.7389 - val_loss: 0.7543 - val_acc: 0.6944
Epoch 1912/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6178 - acc: 0.7319 - val_loss: 0.7495 - val_acc: 0.6889
Epoch 1913/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6180 - acc: 0.7403 - val_loss: 0.7532 - val_acc: 0.6889
Epoch 1914/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6183 - acc: 0.7319 - val_loss: 0.7523 - val_acc: 0.6944
Epoch 1915/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6194 - acc: 0.7417 - val_loss: 0.7525 - val_acc: 0.6889
Epoch 1916/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6205 - acc: 0.7319 - val_loss: 0.7560 - val_acc: 0.6889
Epoch 1917/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6233 - acc: 0.7333 - val_loss: 0.7591 - val_acc: 0.6833
Epoch 1918/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6253 - acc: 0.7319 - val_loss: 0.7605 - val_acc: 0.6833
Epoch 1919/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6315 - acc: 0.7292 - val_loss: 0.7697 - val_acc: 0.6778
Epoch 1920/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6323 - acc: 0.7278 - val_loss: 0.7640 - val_acc: 0.6611
Epoch 1921/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6400 - acc: 0.7236 - val_loss: 0.7742 - val_acc: 0.6833
Epoch 1922/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6340 - acc: 0.7208 - val_loss: 0.7575 - val_acc: 0.6667
Epoch 1923/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6327 - acc: 0.7236 - val_loss: 0.7631 - val_acc: 0.6889
Epoch 1924/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6235 - acc: 0.7306 - val_loss: 0.7522 - val_acc: 0.6889
Epoch 1925/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6185 - acc: 0.7444 - val_loss: 0.7495 - val_acc: 0.6833
Epoch 1926/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6164 - acc: 0.7389 - val_loss: 0.7568 - val_acc: 0.6889
Epoch 1927/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6173 - acc: 0.7361 - val_loss: 0.7482 - val_acc: 0.6778
Epoch 1928/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6196 - acc: 0.7431 - val_loss: 0.7583 - val_acc: 0.6889
Epoch 1929/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6217 - acc: 0.7278 - val_loss: 0.7555 - val_acc: 0.6889
Epoch 1930/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6254 - acc: 0.7306 - val_loss: 0.7579 - val_acc: 0.6833
Epoch 1931/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6255 - acc: 0.7319 - val_loss: 0.7607 - val_acc: 0.6889
Epoch 1932/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6271 - acc: 0.7319 - val_loss: 0.7551 - val_acc: 0.6889
Epoch 1933/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6228 - acc: 0.7292 - val_loss: 0.7521 - val_acc: 0.6889
Epoch 1934/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6196 - acc: 0.7403 - val_loss: 0.7520 - val_acc: 0.6889
Epoch 1935/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6168 - acc: 0.7347 - val_loss: 0.7439 - val_acc: 0.6778
Epoch 1936/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6160 - acc: 0.7417 - val_loss: 0.7530 - val_acc: 0.6944
Epoch 1937/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6165 - acc: 0.7306 - val_loss: 0.7496 - val_acc: 0.6889
Epoch 1938/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6175 - acc: 0.7361 - val_loss: 0.7540 - val_acc: 0.6889
Epoch 1939/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6192 - acc: 0.7361 - val_loss: 0.7576 - val_acc: 0.6889
Epoch 1940/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6201 - acc: 0.7306 - val_loss: 0.7533 - val_acc: 0.6833
Epoch 1941/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6219 - acc: 0.7389 - val_loss: 0.7586 - val_acc: 0.6889
Epoch 1942/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6212 - acc: 0.7292 - val_loss: 0.7494 - val_acc: 0.6778
Epoch 1943/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6213 - acc: 0.7403 - val_loss: 0.7554 - val_acc: 0.6889
Epoch 1944/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6192 - acc: 0.7319 - val_loss: 0.7500 - val_acc: 0.6833
Epoch 1945/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6180 - acc: 0.7417 - val_loss: 0.7504 - val_acc: 0.6889
Epoch 1946/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6164 - acc: 0.7333 - val_loss: 0.7505 - val_acc: 0.6944
Epoch 1947/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6154 - acc: 0.7403 - val_loss: 0.7473 - val_acc: 0.6889
Epoch 1948/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6148 - acc: 0.7389 - val_loss: 0.7485 - val_acc: 0.6889
Epoch 1949/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6146 - acc: 0.7347 - val_loss: 0.7473 - val_acc: 0.6778
Epoch 1950/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6147 - acc: 0.7389 - val_loss: 0.7499 - val_acc: 0.6944
Epoch 1951/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6150 - acc: 0.7333 - val_loss: 0.7497 - val_acc: 0.6889
Epoch 1952/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6155 - acc: 0.7403 - val_loss: 0.7505 - val_acc: 0.6889
Epoch 1953/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6162 - acc: 0.7306 - val_loss: 0.7511 - val_acc: 0.6889
Epoch 1954/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6174 - acc: 0.7417 - val_loss: 0.7522 - val_acc: 0.6889
Epoch 1955/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6183 - acc: 0.7292 - val_loss: 0.7511 - val_acc: 0.6889
Epoch 1956/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6205 - acc: 0.7347 - val_loss: 0.7573 - val_acc: 0.6889
Epoch 1957/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6213 - acc: 0.7333 - val_loss: 0.7543 - val_acc: 0.6833
Epoch 1958/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6245 - acc: 0.7333 - val_loss: 0.7618 - val_acc: 0.6889
Epoch 1959/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6243 - acc: 0.7333 - val_loss: 0.7560 - val_acc: 0.6778
Epoch 1960/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6272 - acc: 0.7347 - val_loss: 0.7623 - val_acc: 0.6833
Epoch 1961/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6246 - acc: 0.7347 - val_loss: 0.7553 - val_acc: 0.6833
Epoch 1962/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6250 - acc: 0.7361 - val_loss: 0.7579 - val_acc: 0.6889
Epoch 1963/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6210 - acc: 0.7347 - val_loss: 0.7540 - val_acc: 0.6889
Epoch 1964/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6191 - acc: 0.7347 - val_loss: 0.7523 - val_acc: 0.6889
Epoch 1965/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6162 - acc: 0.7319 - val_loss: 0.7505 - val_acc: 0.6889
Epoch 1966/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6145 - acc: 0.7389 - val_loss: 0.7484 - val_acc: 0.6833
Epoch 1967/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6136 - acc: 0.7361 - val_loss: 0.7486 - val_acc: 0.6833
Epoch 1968/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6135 - acc: 0.7319 - val_loss: 0.7480 - val_acc: 0.6889
Epoch 1969/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6141 - acc: 0.7375 - val_loss: 0.7496 - val_acc: 0.6889
Epoch 1970/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6150 - acc: 0.7292 - val_loss: 0.7498 - val_acc: 0.6889
Epoch 1971/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6164 - acc: 0.7417 - val_loss: 0.7517 - val_acc: 0.6889
Epoch 1972/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6176 - acc: 0.7292 - val_loss: 0.7509 - val_acc: 0.6889
Epoch 1973/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6198 - acc: 0.7361 - val_loss: 0.7553 - val_acc: 0.6889
Epoch 1974/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6204 - acc: 0.7347 - val_loss: 0.7526 - val_acc: 0.6722
Epoch 1975/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6229 - acc: 0.7347 - val_loss: 0.7589 - val_acc: 0.6889
Epoch 1976/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6217 - acc: 0.7347 - val_loss: 0.7533 - val_acc: 0.6722
Epoch 1977/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6225 - acc: 0.7361 - val_loss: 0.7591 - val_acc: 0.6889
Epoch 1978/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6196 - acc: 0.7319 - val_loss: 0.7504 - val_acc: 0.6833
Epoch 1979/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6183 - acc: 0.7403 - val_loss: 0.7551 - val_acc: 0.6889
Epoch 1980/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6158 - acc: 0.7333 - val_loss: 0.7484 - val_acc: 0.6778
Epoch 1981/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6143 - acc: 0.7431 - val_loss: 0.7504 - val_acc: 0.6889
Epoch 1982/2000
720/720 [==============================] - 0s 10us/step - loss: 0.6131 - acc: 0.7333 - val_loss: 0.7488 - val_acc: 0.6778
Epoch 1983/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6126 - acc: 0.7347 - val_loss: 0.7472 - val_acc: 0.6778
Epoch 1984/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6125 - acc: 0.7361 - val_loss: 0.7492 - val_acc: 0.6944
Epoch 1985/2000
720/720 [==============================] - 0s 13us/step - loss: 0.6127 - acc: 0.7333 - val_loss: 0.7453 - val_acc: 0.6722
Epoch 1986/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6131 - acc: 0.7389 - val_loss: 0.7500 - val_acc: 0.6889
Epoch 1987/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6136 - acc: 0.7347 - val_loss: 0.7460 - val_acc: 0.6833
Epoch 1988/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6146 - acc: 0.7403 - val_loss: 0.7518 - val_acc: 0.6889
Epoch 1989/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6156 - acc: 0.7306 - val_loss: 0.7496 - val_acc: 0.6889
Epoch 1990/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6179 - acc: 0.7361 - val_loss: 0.7554 - val_acc: 0.6889
Epoch 1991/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6194 - acc: 0.7347 - val_loss: 0.7560 - val_acc: 0.6833
Epoch 1992/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6238 - acc: 0.7319 - val_loss: 0.7608 - val_acc: 0.6833
Epoch 1993/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6246 - acc: 0.7333 - val_loss: 0.7630 - val_acc: 0.6778
Epoch 1994/2000
720/720 [==============================] - 0s 12us/step - loss: 0.6300 - acc: 0.7278 - val_loss: 0.7642 - val_acc: 0.6833
Epoch 1995/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6262 - acc: 0.7319 - val_loss: 0.7594 - val_acc: 0.6778
Epoch 1996/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6263 - acc: 0.7347 - val_loss: 0.7615 - val_acc: 0.6889
Epoch 1997/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6198 - acc: 0.7319 - val_loss: 0.7476 - val_acc: 0.6833
Epoch 1998/2000
720/720 [==============================] - 0s 11us/step - loss: 0.6166 - acc: 0.7444 - val_loss: 0.7569 - val_acc: 0.6778
Epoch 1999/2000
720/720 [==============================] - 0s 14us/step - loss: 0.6139 - acc: 0.7375 - val_loss: 0.7437 - val_acc: 0.6778
Epoch 2000/2000
720/720 [==============================] - 0s 15us/step - loss: 0.6128 - acc: 0.7458 - val_loss: 0.7538 - val_acc: 0.6944
Wall time: 25.7 s






    Out[97]:





<tensorflow.python.keras._impl.keras.callbacks.History at 0x1f2744be6d8>



In [98]:

    
train_loss, train_accuracy = model.evaluate(X_train_2_dim, y_train_categorical, batch_size=BATCH_SIZE)
train_accuracy









    



900/900 [==============================] - 0s 6us/step






    Out[98]:





0.7244444489479065



In [99]:

    
test_loss, test_accuracy = model.evaluate(X_test_2_dim, y_test_categorical, batch_size=BATCH_SIZE)
test_accuracy









    



600/600 [==============================] - 0s 5us/step






    Out[99]:





0.699999988079071



In [100]:

    
plot_keras_prediction(model, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, NN",
                fname='nn-test.png')

Even though scores do not look too bad, decision boundaries tell us, this is not a good result. We have several means of regularization for neural networks and we use a combination of them as described below.



In [101]:

    
# https://stackoverflow.com/questions/34716454/where-do-i-call-the-batchnormalization-function-in-keras
# regularisation:
# - dropout
# - batch normalization
# - reduce capacity of model

dropout = 0.6
model = tf.keras.Sequential()

model.add(tf.keras.layers.Dense(100, name='hidden1', input_dim=2))
model.add(tf.keras.layers.BatchNormalization())
# model.add(tf.keras.layers.Activation('tanh'))
model.add(tf.keras.layers.Activation('relu'))
model.add(tf.keras.layers.Dropout(dropout))

model.add(tf.keras.layers.Dense(100, name='hidden2'))
model.add(tf.keras.layers.BatchNormalization())
model.add(tf.keras.layers.Activation('relu'))
# model.add(tf.keras.layers.Activation('tanh'))
model.add(tf.keras.layers.Dropout(dropout))

model.add(tf.keras.layers.Dense(num_categories, name='softmax', activation='softmax'))

model.compile(loss='categorical_crossentropy',
             optimizer='adam',
             metrics=['accuracy'])
model.summary()









    



_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
hidden1 (Dense)              (None, 100)               300       
_________________________________________________________________
batch_normalization_1 (Batch (None, 100)               400       
_________________________________________________________________
activation_1 (Activation)    (None, 100)               0         
_________________________________________________________________
dropout_1 (Dropout)          (None, 100)               0         
_________________________________________________________________
hidden2 (Dense)              (None, 100)               10100     
_________________________________________________________________
batch_normalization_2 (Batch (None, 100)               400       
_________________________________________________________________
activation_2 (Activation)    (None, 100)               0         
_________________________________________________________________
dropout_2 (Dropout)          (None, 100)               0         
_________________________________________________________________
softmax (Dense)              (None, 3)                 303       
=================================================================
Total params: 11,503
Trainable params: 11,103
Non-trainable params: 400
_________________________________________________________________



In [102]:

    
BATCH_SIZE=1000
EPOCHS = 3000

early_stopping = tf.keras.callbacks.EarlyStopping(monitor='val_loss', patience=500, verbose=1)

%time model.fit(X_train_2_dim, y_train_categorical, epochs=EPOCHS, batch_size=BATCH_SIZE, validation_split=0.2, callbacks=[early_stopping])
# %time model.fit(X_train_2_dim, y_train_categorical, epochs=EPOCHS, batch_size=BATCH_SIZE, validation_split=0.2, callbacks=[checkpoint, early_stopping])
# %time model.fit(X_train_2_dim, y_train_categorical, epochs=EPOCHS, batch_size=BATCH_SIZE, validation_split=0.2)









    



Train on 720 samples, validate on 180 samples
Epoch 1/3000
720/720 [==============================] - 1s 768us/step - loss: 1.9788 - acc: 0.3236 - val_loss: 2.8289 - val_acc: 0.3333
Epoch 2/3000
720/720 [==============================] - 0s 17us/step - loss: 1.8322 - acc: 0.3250 - val_loss: 2.7818 - val_acc: 0.2944
Epoch 3/3000
720/720 [==============================] - 0s 15us/step - loss: 1.7204 - acc: 0.3500 - val_loss: 4.5794 - val_acc: 0.3278
Epoch 4/3000
720/720 [==============================] - 0s 15us/step - loss: 1.6569 - acc: 0.3597 - val_loss: 6.5034 - val_acc: 0.3278
Epoch 5/3000
720/720 [==============================] - 0s 14us/step - loss: 1.6143 - acc: 0.3486 - val_loss: 8.0086 - val_acc: 0.3278
Epoch 6/3000
720/720 [==============================] - 0s 14us/step - loss: 1.5546 - acc: 0.3639 - val_loss: 9.0995 - val_acc: 0.3278
Epoch 7/3000
720/720 [==============================] - 0s 17us/step - loss: 1.5008 - acc: 0.3694 - val_loss: 9.8699 - val_acc: 0.3278
Epoch 8/3000
720/720 [==============================] - 0s 15us/step - loss: 1.4116 - acc: 0.3833 - val_loss: 10.3622 - val_acc: 0.3278
Epoch 9/3000
720/720 [==============================] - 0s 14us/step - loss: 1.5301 - acc: 0.3708 - val_loss: 10.6351 - val_acc: 0.3278
Epoch 10/3000
720/720 [==============================] - 0s 14us/step - loss: 1.4944 - acc: 0.3458 - val_loss: 10.7701 - val_acc: 0.3278
Epoch 11/3000
720/720 [==============================] - 0s 14us/step - loss: 1.3559 - acc: 0.4181 - val_loss: 10.8190 - val_acc: 0.3278
Epoch 12/3000
720/720 [==============================] - 0s 15us/step - loss: 1.3355 - acc: 0.4028 - val_loss: 10.8312 - val_acc: 0.3278
Epoch 13/3000
720/720 [==============================] - 0s 15us/step - loss: 1.3026 - acc: 0.4194 - val_loss: 10.8349 - val_acc: 0.3278
Epoch 14/3000
720/720 [==============================] - 0s 15us/step - loss: 1.2501 - acc: 0.4333 - val_loss: 10.8349 - val_acc: 0.3278
Epoch 15/3000
720/720 [==============================] - 0s 14us/step - loss: 1.2082 - acc: 0.4389 - val_loss: 10.8347 - val_acc: 0.3278
Epoch 16/3000
720/720 [==============================] - 0s 14us/step - loss: 1.2270 - acc: 0.4250 - val_loss: 10.8315 - val_acc: 0.3278
Epoch 17/3000
720/720 [==============================] - 0s 15us/step - loss: 1.1764 - acc: 0.4611 - val_loss: 10.8136 - val_acc: 0.3278
Epoch 18/3000
720/720 [==============================] - 0s 15us/step - loss: 1.2321 - acc: 0.4514 - val_loss: 10.7741 - val_acc: 0.3278
Epoch 19/3000
720/720 [==============================] - 0s 17us/step - loss: 1.2792 - acc: 0.4389 - val_loss: 10.7078 - val_acc: 0.3278
Epoch 20/3000
720/720 [==============================] - 0s 15us/step - loss: 1.1863 - acc: 0.4764 - val_loss: 10.6007 - val_acc: 0.3278
Epoch 21/3000
720/720 [==============================] - 0s 15us/step - loss: 1.2344 - acc: 0.4750 - val_loss: 10.4498 - val_acc: 0.3278
Epoch 22/3000
720/720 [==============================] - 0s 15us/step - loss: 1.1772 - acc: 0.4708 - val_loss: 10.2499 - val_acc: 0.3278
Epoch 23/3000
720/720 [==============================] - 0s 14us/step - loss: 1.1784 - acc: 0.4653 - val_loss: 9.9886 - val_acc: 0.3278
Epoch 24/3000
720/720 [==============================] - 0s 17us/step - loss: 1.1730 - acc: 0.4722 - val_loss: 9.6898 - val_acc: 0.3278
Epoch 25/3000
720/720 [==============================] - 0s 14us/step - loss: 1.1590 - acc: 0.4806 - val_loss: 9.3532 - val_acc: 0.3278
Epoch 26/3000
720/720 [==============================] - 0s 15us/step - loss: 1.1198 - acc: 0.4806 - val_loss: 8.9785 - val_acc: 0.3278
Epoch 27/3000
720/720 [==============================] - 0s 17us/step - loss: 1.1370 - acc: 0.4778 - val_loss: 8.6161 - val_acc: 0.3278
Epoch 28/3000
720/720 [==============================] - 0s 15us/step - loss: 1.1235 - acc: 0.4778 - val_loss: 8.2622 - val_acc: 0.3278
Epoch 29/3000
720/720 [==============================] - 0s 15us/step - loss: 1.1315 - acc: 0.4903 - val_loss: 7.9021 - val_acc: 0.3278
Epoch 30/3000
720/720 [==============================] - 0s 15us/step - loss: 1.1183 - acc: 0.4903 - val_loss: 7.5573 - val_acc: 0.3278
Epoch 31/3000
720/720 [==============================] - 0s 14us/step - loss: 1.1033 - acc: 0.4917 - val_loss: 7.2190 - val_acc: 0.3278
Epoch 32/3000
720/720 [==============================] - 0s 14us/step - loss: 1.1217 - acc: 0.4972 - val_loss: 6.9026 - val_acc: 0.3278
Epoch 33/3000
720/720 [==============================] - 0s 15us/step - loss: 1.1275 - acc: 0.4958 - val_loss: 6.6043 - val_acc: 0.3278
Epoch 34/3000
720/720 [==============================] - 0s 15us/step - loss: 1.0804 - acc: 0.5250 - val_loss: 6.3369 - val_acc: 0.3278
Epoch 35/3000
720/720 [==============================] - 0s 14us/step - loss: 1.1072 - acc: 0.4847 - val_loss: 6.1133 - val_acc: 0.3278
Epoch 36/3000
720/720 [==============================] - 0s 14us/step - loss: 1.0392 - acc: 0.5333 - val_loss: 5.9252 - val_acc: 0.3444
Epoch 37/3000
720/720 [==============================] - 0s 14us/step - loss: 1.0781 - acc: 0.5042 - val_loss: 5.7738 - val_acc: 0.3444
Epoch 38/3000
720/720 [==============================] - 0s 15us/step - loss: 1.0540 - acc: 0.5042 - val_loss: 5.6504 - val_acc: 0.3611
Epoch 39/3000
720/720 [==============================] - 0s 15us/step - loss: 1.0433 - acc: 0.5139 - val_loss: 5.5555 - val_acc: 0.3833
Epoch 40/3000
720/720 [==============================] - 0s 15us/step - loss: 1.0847 - acc: 0.5167 - val_loss: 5.4790 - val_acc: 0.4056
Epoch 41/3000
720/720 [==============================] - 0s 14us/step - loss: 1.0072 - acc: 0.5431 - val_loss: 5.4135 - val_acc: 0.4000
Epoch 42/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9970 - acc: 0.5528 - val_loss: 5.3576 - val_acc: 0.4056
Epoch 43/3000
720/720 [==============================] - 0s 14us/step - loss: 1.0074 - acc: 0.5292 - val_loss: 5.3098 - val_acc: 0.4167
Epoch 44/3000
720/720 [==============================] - 0s 15us/step - loss: 1.0356 - acc: 0.5375 - val_loss: 5.2656 - val_acc: 0.4444
Epoch 45/3000
720/720 [==============================] - 0s 14us/step - loss: 1.0558 - acc: 0.5417 - val_loss: 5.2167 - val_acc: 0.4389
Epoch 46/3000
720/720 [==============================] - 0s 14us/step - loss: 1.0596 - acc: 0.5361 - val_loss: 5.1677 - val_acc: 0.4444
Epoch 47/3000
720/720 [==============================] - 0s 15us/step - loss: 1.0584 - acc: 0.5167 - val_loss: 5.1213 - val_acc: 0.4389
Epoch 48/3000
720/720 [==============================] - 0s 14us/step - loss: 1.0137 - acc: 0.5319 - val_loss: 5.0716 - val_acc: 0.4500
Epoch 49/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9846 - acc: 0.5431 - val_loss: 5.0225 - val_acc: 0.4500
Epoch 50/3000
720/720 [==============================] - 0s 13us/step - loss: 1.0060 - acc: 0.5569 - val_loss: 4.9760 - val_acc: 0.4667
Epoch 51/3000
720/720 [==============================] - 0s 12us/step - loss: 0.9871 - acc: 0.5736 - val_loss: 4.9275 - val_acc: 0.4500
Epoch 52/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9548 - acc: 0.5736 - val_loss: 4.8783 - val_acc: 0.4500
Epoch 53/3000
720/720 [==============================] - 0s 14us/step - loss: 1.0056 - acc: 0.5361 - val_loss: 4.8279 - val_acc: 0.4500
Epoch 54/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9862 - acc: 0.5736 - val_loss: 4.7730 - val_acc: 0.4556
Epoch 55/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9732 - acc: 0.5625 - val_loss: 4.7154 - val_acc: 0.4556
Epoch 56/3000
720/720 [==============================] - 0s 12us/step - loss: 0.9458 - acc: 0.5722 - val_loss: 4.6530 - val_acc: 0.4556
Epoch 57/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9766 - acc: 0.5569 - val_loss: 4.5812 - val_acc: 0.4500
Epoch 58/3000
720/720 [==============================] - 0s 13us/step - loss: 0.9412 - acc: 0.5667 - val_loss: 4.5062 - val_acc: 0.4500
Epoch 59/3000
720/720 [==============================] - 0s 12us/step - loss: 0.9919 - acc: 0.5722 - val_loss: 4.4379 - val_acc: 0.4500
Epoch 60/3000
720/720 [==============================] - 0s 13us/step - loss: 0.9498 - acc: 0.5542 - val_loss: 4.3662 - val_acc: 0.4556
Epoch 61/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9657 - acc: 0.5611 - val_loss: 4.2965 - val_acc: 0.4611
Epoch 62/3000
720/720 [==============================] - 0s 12us/step - loss: 0.9587 - acc: 0.5889 - val_loss: 4.2325 - val_acc: 0.4500
Epoch 63/3000
720/720 [==============================] - 0s 12us/step - loss: 0.9758 - acc: 0.5625 - val_loss: 4.1701 - val_acc: 0.4500
Epoch 64/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9743 - acc: 0.5681 - val_loss: 4.1085 - val_acc: 0.4500
Epoch 65/3000
720/720 [==============================] - 0s 12us/step - loss: 0.9521 - acc: 0.5903 - val_loss: 4.0461 - val_acc: 0.4500
Epoch 66/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9949 - acc: 0.5708 - val_loss: 3.9849 - val_acc: 0.4500
Epoch 67/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9738 - acc: 0.5694 - val_loss: 3.9245 - val_acc: 0.4389
Epoch 68/3000
720/720 [==============================] - 0s 22us/step - loss: 0.9772 - acc: 0.5681 - val_loss: 3.8649 - val_acc: 0.4389
Epoch 69/3000
720/720 [==============================] - 0s 15us/step - loss: 0.9304 - acc: 0.5875 - val_loss: 3.8128 - val_acc: 0.4389
Epoch 70/3000
720/720 [==============================] - 0s 17us/step - loss: 0.9494 - acc: 0.5736 - val_loss: 3.7644 - val_acc: 0.4333
Epoch 71/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9327 - acc: 0.5903 - val_loss: 3.7133 - val_acc: 0.4389
Epoch 72/3000
720/720 [==============================] - 0s 13us/step - loss: 0.9236 - acc: 0.5806 - val_loss: 3.6672 - val_acc: 0.4389
Epoch 73/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9381 - acc: 0.5694 - val_loss: 3.6182 - val_acc: 0.4389
Epoch 74/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9531 - acc: 0.5958 - val_loss: 3.5685 - val_acc: 0.4278
Epoch 75/3000
720/720 [==============================] - 0s 15us/step - loss: 0.9006 - acc: 0.6153 - val_loss: 3.5246 - val_acc: 0.4333
Epoch 76/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9155 - acc: 0.5792 - val_loss: 3.4861 - val_acc: 0.4333
Epoch 77/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9035 - acc: 0.5875 - val_loss: 3.4487 - val_acc: 0.4333
Epoch 78/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8819 - acc: 0.6056 - val_loss: 3.4081 - val_acc: 0.4278
Epoch 79/3000
720/720 [==============================] - 0s 13us/step - loss: 0.9589 - acc: 0.5833 - val_loss: 3.3701 - val_acc: 0.4333
Epoch 80/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9315 - acc: 0.5875 - val_loss: 3.3280 - val_acc: 0.4333
Epoch 81/3000
720/720 [==============================] - 0s 15us/step - loss: 0.9361 - acc: 0.5764 - val_loss: 3.2876 - val_acc: 0.4333
Epoch 82/3000
720/720 [==============================] - 0s 17us/step - loss: 0.9037 - acc: 0.5875 - val_loss: 3.2434 - val_acc: 0.4444
Epoch 83/3000
720/720 [==============================] - 0s 15us/step - loss: 0.9309 - acc: 0.5819 - val_loss: 3.2045 - val_acc: 0.4444
Epoch 84/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9320 - acc: 0.5667 - val_loss: 3.1687 - val_acc: 0.4500
Epoch 85/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9132 - acc: 0.5778 - val_loss: 3.1350 - val_acc: 0.4500
Epoch 86/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8878 - acc: 0.6056 - val_loss: 3.0990 - val_acc: 0.4500
Epoch 87/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9251 - acc: 0.5819 - val_loss: 3.0597 - val_acc: 0.4556
Epoch 88/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9079 - acc: 0.5986 - val_loss: 3.0241 - val_acc: 0.4556
Epoch 89/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9444 - acc: 0.5778 - val_loss: 2.9896 - val_acc: 0.4500
Epoch 90/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9133 - acc: 0.6097 - val_loss: 2.9590 - val_acc: 0.4500
Epoch 91/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9162 - acc: 0.5986 - val_loss: 2.9323 - val_acc: 0.4444
Epoch 92/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9028 - acc: 0.5972 - val_loss: 2.9070 - val_acc: 0.4444
Epoch 93/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9233 - acc: 0.6097 - val_loss: 2.8822 - val_acc: 0.4333
Epoch 94/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9096 - acc: 0.5819 - val_loss: 2.8598 - val_acc: 0.4333
Epoch 95/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8897 - acc: 0.6028 - val_loss: 2.8358 - val_acc: 0.4333
Epoch 96/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8843 - acc: 0.6056 - val_loss: 2.8124 - val_acc: 0.4278
Epoch 97/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8827 - acc: 0.6194 - val_loss: 2.7850 - val_acc: 0.4278
Epoch 98/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9123 - acc: 0.6139 - val_loss: 2.7588 - val_acc: 0.4222
Epoch 99/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8963 - acc: 0.5903 - val_loss: 2.7323 - val_acc: 0.4222
Epoch 100/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8835 - acc: 0.6250 - val_loss: 2.7061 - val_acc: 0.4222
Epoch 101/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8818 - acc: 0.6125 - val_loss: 2.6779 - val_acc: 0.4222
Epoch 102/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8830 - acc: 0.6097 - val_loss: 2.6580 - val_acc: 0.4000
Epoch 103/3000
720/720 [==============================] - 0s 17us/step - loss: 0.8724 - acc: 0.6111 - val_loss: 2.6383 - val_acc: 0.4000
Epoch 104/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8768 - acc: 0.6125 - val_loss: 2.6204 - val_acc: 0.3944
Epoch 105/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9110 - acc: 0.5792 - val_loss: 2.6014 - val_acc: 0.3944
Epoch 106/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8813 - acc: 0.6167 - val_loss: 2.5837 - val_acc: 0.4000
Epoch 107/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9072 - acc: 0.6042 - val_loss: 2.5665 - val_acc: 0.4000
Epoch 108/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8615 - acc: 0.6083 - val_loss: 2.5511 - val_acc: 0.4000
Epoch 109/3000
720/720 [==============================] - 0s 14us/step - loss: 0.9173 - acc: 0.6167 - val_loss: 2.5314 - val_acc: 0.4000
Epoch 110/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8798 - acc: 0.6125 - val_loss: 2.5146 - val_acc: 0.3944
Epoch 111/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8816 - acc: 0.5944 - val_loss: 2.5001 - val_acc: 0.3889
Epoch 112/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8989 - acc: 0.6000 - val_loss: 2.4861 - val_acc: 0.3889
Epoch 113/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8730 - acc: 0.6111 - val_loss: 2.4698 - val_acc: 0.3833
Epoch 114/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8760 - acc: 0.6167 - val_loss: 2.4493 - val_acc: 0.3833
Epoch 115/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8922 - acc: 0.6125 - val_loss: 2.4327 - val_acc: 0.3778
Epoch 116/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8984 - acc: 0.6222 - val_loss: 2.4164 - val_acc: 0.3778
Epoch 117/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8870 - acc: 0.5972 - val_loss: 2.4029 - val_acc: 0.3667
Epoch 118/3000
720/720 [==============================] - 0s 17us/step - loss: 0.8848 - acc: 0.5944 - val_loss: 2.3892 - val_acc: 0.3500
Epoch 119/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8823 - acc: 0.6181 - val_loss: 2.3794 - val_acc: 0.3444
Epoch 120/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8420 - acc: 0.6208 - val_loss: 2.3710 - val_acc: 0.3333
Epoch 121/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8487 - acc: 0.6097 - val_loss: 2.3595 - val_acc: 0.3333
Epoch 122/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8586 - acc: 0.6125 - val_loss: 2.3480 - val_acc: 0.3333
Epoch 123/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8575 - acc: 0.6139 - val_loss: 2.3368 - val_acc: 0.3444
Epoch 124/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8749 - acc: 0.6042 - val_loss: 2.3265 - val_acc: 0.3444
Epoch 125/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8482 - acc: 0.6319 - val_loss: 2.3162 - val_acc: 0.3444
Epoch 126/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8671 - acc: 0.6097 - val_loss: 2.3028 - val_acc: 0.3389
Epoch 127/3000
720/720 [==============================] - 0s 26us/step - loss: 0.8946 - acc: 0.6014 - val_loss: 2.2914 - val_acc: 0.3389
Epoch 128/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8368 - acc: 0.6083 - val_loss: 2.2763 - val_acc: 0.3389
Epoch 129/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8654 - acc: 0.6458 - val_loss: 2.2591 - val_acc: 0.3389
Epoch 130/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8509 - acc: 0.6208 - val_loss: 2.2414 - val_acc: 0.3389
Epoch 131/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8343 - acc: 0.6319 - val_loss: 2.2251 - val_acc: 0.3333
Epoch 132/3000
720/720 [==============================] - 0s 19us/step - loss: 0.8722 - acc: 0.6278 - val_loss: 2.2100 - val_acc: 0.3333
Epoch 133/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8642 - acc: 0.6264 - val_loss: 2.1917 - val_acc: 0.3278
Epoch 134/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8700 - acc: 0.6181 - val_loss: 2.1734 - val_acc: 0.3333
Epoch 135/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8105 - acc: 0.6403 - val_loss: 2.1571 - val_acc: 0.3333
Epoch 136/3000
720/720 [==============================] - 0s 12us/step - loss: 0.8679 - acc: 0.6319 - val_loss: 2.1421 - val_acc: 0.3333
Epoch 137/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8528 - acc: 0.6250 - val_loss: 2.1219 - val_acc: 0.3333
Epoch 138/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8552 - acc: 0.6278 - val_loss: 2.1001 - val_acc: 0.3278
Epoch 139/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8469 - acc: 0.6097 - val_loss: 2.0751 - val_acc: 0.3333
Epoch 140/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8575 - acc: 0.6333 - val_loss: 2.0473 - val_acc: 0.3333
Epoch 141/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8198 - acc: 0.6431 - val_loss: 2.0188 - val_acc: 0.3222
Epoch 142/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8170 - acc: 0.6250 - val_loss: 1.9881 - val_acc: 0.3222
Epoch 143/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8193 - acc: 0.6306 - val_loss: 1.9579 - val_acc: 0.3333
Epoch 144/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8409 - acc: 0.6333 - val_loss: 1.9320 - val_acc: 0.3333
Epoch 145/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8912 - acc: 0.6000 - val_loss: 1.9081 - val_acc: 0.3389
Epoch 146/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8613 - acc: 0.6181 - val_loss: 1.8846 - val_acc: 0.3389
Epoch 147/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8533 - acc: 0.6208 - val_loss: 1.8618 - val_acc: 0.3389
Epoch 148/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8400 - acc: 0.6236 - val_loss: 1.8364 - val_acc: 0.3389
Epoch 149/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8470 - acc: 0.6194 - val_loss: 1.8143 - val_acc: 0.3389
Epoch 150/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8659 - acc: 0.6000 - val_loss: 1.7979 - val_acc: 0.3444
Epoch 151/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8109 - acc: 0.6361 - val_loss: 1.7828 - val_acc: 0.3389
Epoch 152/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8562 - acc: 0.6097 - val_loss: 1.7729 - val_acc: 0.3556
Epoch 153/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8103 - acc: 0.6167 - val_loss: 1.7635 - val_acc: 0.3611
Epoch 154/3000
720/720 [==============================] - 0s 17us/step - loss: 0.8449 - acc: 0.6361 - val_loss: 1.7568 - val_acc: 0.3611
Epoch 155/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8244 - acc: 0.6250 - val_loss: 1.7504 - val_acc: 0.3667
Epoch 156/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8425 - acc: 0.6389 - val_loss: 1.7465 - val_acc: 0.3722
Epoch 157/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8612 - acc: 0.6250 - val_loss: 1.7411 - val_acc: 0.3722
Epoch 158/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8579 - acc: 0.6306 - val_loss: 1.7369 - val_acc: 0.3722
Epoch 159/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8460 - acc: 0.6167 - val_loss: 1.7365 - val_acc: 0.3778
Epoch 160/3000
720/720 [==============================] - 0s 17us/step - loss: 0.8234 - acc: 0.6458 - val_loss: 1.7356 - val_acc: 0.3778
Epoch 161/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8214 - acc: 0.6181 - val_loss: 1.7361 - val_acc: 0.3833
Epoch 162/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8570 - acc: 0.6167 - val_loss: 1.7374 - val_acc: 0.3778
Epoch 163/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8275 - acc: 0.6458 - val_loss: 1.7360 - val_acc: 0.3778
Epoch 164/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8495 - acc: 0.6250 - val_loss: 1.7307 - val_acc: 0.3778
Epoch 165/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8214 - acc: 0.6389 - val_loss: 1.7256 - val_acc: 0.3944
Epoch 166/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8403 - acc: 0.6542 - val_loss: 1.7212 - val_acc: 0.4000
Epoch 167/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8618 - acc: 0.6333 - val_loss: 1.7171 - val_acc: 0.4056
Epoch 168/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8486 - acc: 0.6375 - val_loss: 1.7116 - val_acc: 0.4167
Epoch 169/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8026 - acc: 0.6347 - val_loss: 1.7031 - val_acc: 0.4167
Epoch 170/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8188 - acc: 0.6264 - val_loss: 1.6879 - val_acc: 0.4167
Epoch 171/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8108 - acc: 0.6389 - val_loss: 1.6709 - val_acc: 0.4111
Epoch 172/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8199 - acc: 0.6264 - val_loss: 1.6587 - val_acc: 0.4056
Epoch 173/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8190 - acc: 0.6417 - val_loss: 1.6469 - val_acc: 0.4000
Epoch 174/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8167 - acc: 0.6431 - val_loss: 1.6354 - val_acc: 0.4000
Epoch 175/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8176 - acc: 0.6389 - val_loss: 1.6191 - val_acc: 0.4000
Epoch 176/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8602 - acc: 0.6222 - val_loss: 1.6027 - val_acc: 0.4056
Epoch 177/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8291 - acc: 0.6542 - val_loss: 1.5896 - val_acc: 0.4167
Epoch 178/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8414 - acc: 0.6403 - val_loss: 1.5789 - val_acc: 0.4111
Epoch 179/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8157 - acc: 0.6653 - val_loss: 1.5679 - val_acc: 0.4167
Epoch 180/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8113 - acc: 0.6500 - val_loss: 1.5573 - val_acc: 0.4167
Epoch 181/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8159 - acc: 0.6528 - val_loss: 1.5512 - val_acc: 0.4167
Epoch 182/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8053 - acc: 0.6417 - val_loss: 1.5432 - val_acc: 0.4111
Epoch 183/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7991 - acc: 0.6403 - val_loss: 1.5364 - val_acc: 0.4167
Epoch 184/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8062 - acc: 0.6611 - val_loss: 1.5319 - val_acc: 0.4222
Epoch 185/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8373 - acc: 0.6389 - val_loss: 1.5289 - val_acc: 0.4222
Epoch 186/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8442 - acc: 0.6153 - val_loss: 1.5292 - val_acc: 0.4278
Epoch 187/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8328 - acc: 0.6222 - val_loss: 1.5265 - val_acc: 0.4278
Epoch 188/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8065 - acc: 0.6347 - val_loss: 1.5235 - val_acc: 0.4278
Epoch 189/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8150 - acc: 0.6306 - val_loss: 1.5161 - val_acc: 0.4278
Epoch 190/3000
720/720 [==============================] - 0s 17us/step - loss: 0.8025 - acc: 0.6403 - val_loss: 1.5104 - val_acc: 0.4333
Epoch 191/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8365 - acc: 0.6542 - val_loss: 1.5034 - val_acc: 0.4333
Epoch 192/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8309 - acc: 0.6431 - val_loss: 1.4928 - val_acc: 0.4389
Epoch 193/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8202 - acc: 0.6556 - val_loss: 1.4819 - val_acc: 0.4389
Epoch 194/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8217 - acc: 0.6556 - val_loss: 1.4762 - val_acc: 0.4333
Epoch 195/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8082 - acc: 0.6458 - val_loss: 1.4687 - val_acc: 0.4444
Epoch 196/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8282 - acc: 0.6278 - val_loss: 1.4580 - val_acc: 0.4500
Epoch 197/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8271 - acc: 0.6444 - val_loss: 1.4488 - val_acc: 0.4500
Epoch 198/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8143 - acc: 0.6444 - val_loss: 1.4383 - val_acc: 0.4444
Epoch 199/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8019 - acc: 0.6472 - val_loss: 1.4281 - val_acc: 0.4444
Epoch 200/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8151 - acc: 0.6458 - val_loss: 1.4188 - val_acc: 0.4444
Epoch 201/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8059 - acc: 0.6417 - val_loss: 1.4111 - val_acc: 0.4444
Epoch 202/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7901 - acc: 0.6472 - val_loss: 1.4060 - val_acc: 0.4556
Epoch 203/3000
720/720 [==============================] - 0s 28us/step - loss: 0.8190 - acc: 0.6639 - val_loss: 1.4000 - val_acc: 0.4556
Epoch 204/3000
720/720 [==============================] - 0s 28us/step - loss: 0.8371 - acc: 0.6250 - val_loss: 1.3916 - val_acc: 0.4667
Epoch 205/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8178 - acc: 0.6472 - val_loss: 1.3807 - val_acc: 0.4667
Epoch 206/3000
720/720 [==============================] - 0s 13us/step - loss: 0.8233 - acc: 0.6403 - val_loss: 1.3681 - val_acc: 0.4722
Epoch 207/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7961 - acc: 0.6444 - val_loss: 1.3565 - val_acc: 0.4778
Epoch 208/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8118 - acc: 0.6528 - val_loss: 1.3435 - val_acc: 0.4833
Epoch 209/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7953 - acc: 0.6528 - val_loss: 1.3294 - val_acc: 0.4889
Epoch 210/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7852 - acc: 0.6514 - val_loss: 1.3151 - val_acc: 0.4889
Epoch 211/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8125 - acc: 0.6514 - val_loss: 1.2996 - val_acc: 0.4889
Epoch 212/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8249 - acc: 0.6486 - val_loss: 1.2854 - val_acc: 0.4944
Epoch 213/3000
720/720 [==============================] - 0s 13us/step - loss: 0.8116 - acc: 0.6361 - val_loss: 1.2708 - val_acc: 0.4944
Epoch 214/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8228 - acc: 0.6486 - val_loss: 1.2609 - val_acc: 0.4944
Epoch 215/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7841 - acc: 0.6486 - val_loss: 1.2538 - val_acc: 0.5000
Epoch 216/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7934 - acc: 0.6653 - val_loss: 1.2443 - val_acc: 0.5056
Epoch 217/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8331 - acc: 0.6319 - val_loss: 1.2328 - val_acc: 0.5111
Epoch 218/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7988 - acc: 0.6458 - val_loss: 1.2211 - val_acc: 0.5111
Epoch 219/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7917 - acc: 0.6653 - val_loss: 1.2108 - val_acc: 0.5111
Epoch 220/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8276 - acc: 0.6500 - val_loss: 1.2028 - val_acc: 0.5111
Epoch 221/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7972 - acc: 0.6500 - val_loss: 1.1958 - val_acc: 0.5167
Epoch 222/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7946 - acc: 0.6583 - val_loss: 1.1890 - val_acc: 0.5167
Epoch 223/3000
720/720 [==============================] - 0s 17us/step - loss: 0.8068 - acc: 0.6444 - val_loss: 1.1830 - val_acc: 0.5167
Epoch 224/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7725 - acc: 0.6681 - val_loss: 1.1773 - val_acc: 0.5222
Epoch 225/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7862 - acc: 0.6569 - val_loss: 1.1720 - val_acc: 0.5222
Epoch 226/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7778 - acc: 0.6764 - val_loss: 1.1667 - val_acc: 0.5278
Epoch 227/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8041 - acc: 0.6625 - val_loss: 1.1612 - val_acc: 0.5389
Epoch 228/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8035 - acc: 0.6403 - val_loss: 1.1545 - val_acc: 0.5389
Epoch 229/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8092 - acc: 0.6361 - val_loss: 1.1455 - val_acc: 0.5389
Epoch 230/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8071 - acc: 0.6681 - val_loss: 1.1349 - val_acc: 0.5389
Epoch 231/3000
720/720 [==============================] - 0s 12us/step - loss: 0.8202 - acc: 0.6500 - val_loss: 1.1250 - val_acc: 0.5444
Epoch 232/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8324 - acc: 0.6333 - val_loss: 1.1151 - val_acc: 0.5500
Epoch 233/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8063 - acc: 0.6375 - val_loss: 1.1061 - val_acc: 0.5500
Epoch 234/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7818 - acc: 0.6667 - val_loss: 1.1024 - val_acc: 0.5611
Epoch 235/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8163 - acc: 0.6625 - val_loss: 1.1039 - val_acc: 0.5611
Epoch 236/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7974 - acc: 0.6625 - val_loss: 1.1067 - val_acc: 0.5611
Epoch 237/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7892 - acc: 0.6542 - val_loss: 1.1098 - val_acc: 0.5611
Epoch 238/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7864 - acc: 0.6431 - val_loss: 1.1115 - val_acc: 0.5611
Epoch 239/3000
720/720 [==============================] - 0s 17us/step - loss: 0.8092 - acc: 0.6528 - val_loss: 1.1142 - val_acc: 0.5556
Epoch 240/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8006 - acc: 0.6458 - val_loss: 1.1166 - val_acc: 0.5500
Epoch 241/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8080 - acc: 0.6361 - val_loss: 1.1202 - val_acc: 0.5444
Epoch 242/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7785 - acc: 0.6583 - val_loss: 1.1252 - val_acc: 0.5389
Epoch 243/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7913 - acc: 0.6597 - val_loss: 1.1298 - val_acc: 0.5333
Epoch 244/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7558 - acc: 0.6792 - val_loss: 1.1345 - val_acc: 0.5333
Epoch 245/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7964 - acc: 0.6639 - val_loss: 1.1409 - val_acc: 0.5333
Epoch 246/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8205 - acc: 0.6458 - val_loss: 1.1472 - val_acc: 0.5333
Epoch 247/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8393 - acc: 0.6389 - val_loss: 1.1550 - val_acc: 0.5278
Epoch 248/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7951 - acc: 0.6681 - val_loss: 1.1613 - val_acc: 0.5222
Epoch 249/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7793 - acc: 0.6736 - val_loss: 1.1651 - val_acc: 0.5222
Epoch 250/3000
720/720 [==============================] - 0s 12us/step - loss: 0.8057 - acc: 0.6639 - val_loss: 1.1652 - val_acc: 0.5222
Epoch 251/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7778 - acc: 0.6778 - val_loss: 1.1624 - val_acc: 0.5222
Epoch 252/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8016 - acc: 0.6500 - val_loss: 1.1574 - val_acc: 0.5222
Epoch 253/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7818 - acc: 0.6708 - val_loss: 1.1512 - val_acc: 0.5278
Epoch 254/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7847 - acc: 0.6694 - val_loss: 1.1440 - val_acc: 0.5222
Epoch 255/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7938 - acc: 0.6500 - val_loss: 1.1326 - val_acc: 0.5222
Epoch 256/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8283 - acc: 0.6556 - val_loss: 1.1131 - val_acc: 0.5278
Epoch 257/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8120 - acc: 0.6625 - val_loss: 1.0933 - val_acc: 0.5389
Epoch 258/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7932 - acc: 0.6556 - val_loss: 1.0718 - val_acc: 0.5333
Epoch 259/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8070 - acc: 0.6417 - val_loss: 1.0541 - val_acc: 0.5333
Epoch 260/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7901 - acc: 0.6500 - val_loss: 1.0397 - val_acc: 0.5389
Epoch 261/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7962 - acc: 0.6611 - val_loss: 1.0270 - val_acc: 0.5444
Epoch 262/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7953 - acc: 0.6667 - val_loss: 1.0156 - val_acc: 0.5500
Epoch 263/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7987 - acc: 0.6583 - val_loss: 1.0061 - val_acc: 0.5667
Epoch 264/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7912 - acc: 0.6750 - val_loss: 0.9998 - val_acc: 0.5667
Epoch 265/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7879 - acc: 0.6486 - val_loss: 0.9938 - val_acc: 0.5722
Epoch 266/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8100 - acc: 0.6486 - val_loss: 0.9906 - val_acc: 0.5722
Epoch 267/3000
720/720 [==============================] - 0s 13us/step - loss: 0.8141 - acc: 0.6486 - val_loss: 0.9877 - val_acc: 0.5722
Epoch 268/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7725 - acc: 0.6653 - val_loss: 0.9859 - val_acc: 0.5722
Epoch 269/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7789 - acc: 0.6528 - val_loss: 0.9820 - val_acc: 0.5667
Epoch 270/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7893 - acc: 0.6653 - val_loss: 0.9784 - val_acc: 0.5667
Epoch 271/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7885 - acc: 0.6472 - val_loss: 0.9725 - val_acc: 0.5722
Epoch 272/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8027 - acc: 0.6736 - val_loss: 0.9695 - val_acc: 0.5778
Epoch 273/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7721 - acc: 0.6778 - val_loss: 0.9680 - val_acc: 0.5778
Epoch 274/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8037 - acc: 0.6472 - val_loss: 0.9674 - val_acc: 0.5833
Epoch 275/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7872 - acc: 0.6556 - val_loss: 0.9681 - val_acc: 0.5778
Epoch 276/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7816 - acc: 0.6625 - val_loss: 0.9680 - val_acc: 0.5833
Epoch 277/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7774 - acc: 0.6458 - val_loss: 0.9663 - val_acc: 0.5889
Epoch 278/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7792 - acc: 0.6667 - val_loss: 0.9616 - val_acc: 0.5889
Epoch 279/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8095 - acc: 0.6361 - val_loss: 0.9561 - val_acc: 0.5889
Epoch 280/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7877 - acc: 0.6750 - val_loss: 0.9506 - val_acc: 0.6000
Epoch 281/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7807 - acc: 0.6500 - val_loss: 0.9449 - val_acc: 0.5944
Epoch 282/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7785 - acc: 0.6667 - val_loss: 0.9374 - val_acc: 0.5944
Epoch 283/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7934 - acc: 0.6639 - val_loss: 0.9316 - val_acc: 0.5944
Epoch 284/3000
720/720 [==============================] - 0s 15us/step - loss: 0.8009 - acc: 0.6569 - val_loss: 0.9262 - val_acc: 0.6000
Epoch 285/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7888 - acc: 0.6514 - val_loss: 0.9216 - val_acc: 0.6000
Epoch 286/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7709 - acc: 0.6764 - val_loss: 0.9175 - val_acc: 0.6056
Epoch 287/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7765 - acc: 0.6639 - val_loss: 0.9114 - val_acc: 0.6056
Epoch 288/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7888 - acc: 0.6653 - val_loss: 0.9055 - val_acc: 0.6111
Epoch 289/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7733 - acc: 0.6639 - val_loss: 0.9026 - val_acc: 0.6111
Epoch 290/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7833 - acc: 0.6667 - val_loss: 0.9015 - val_acc: 0.6111
Epoch 291/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7647 - acc: 0.6681 - val_loss: 0.9001 - val_acc: 0.6111
Epoch 292/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7772 - acc: 0.6722 - val_loss: 0.8977 - val_acc: 0.6167
Epoch 293/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7617 - acc: 0.6792 - val_loss: 0.8967 - val_acc: 0.6167
Epoch 294/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7789 - acc: 0.6708 - val_loss: 0.8963 - val_acc: 0.6167
Epoch 295/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7760 - acc: 0.6569 - val_loss: 0.8962 - val_acc: 0.6111
Epoch 296/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7997 - acc: 0.6444 - val_loss: 0.8994 - val_acc: 0.6111
Epoch 297/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7811 - acc: 0.6625 - val_loss: 0.9030 - val_acc: 0.6056
Epoch 298/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7703 - acc: 0.6708 - val_loss: 0.9080 - val_acc: 0.6056
Epoch 299/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7921 - acc: 0.6667 - val_loss: 0.9111 - val_acc: 0.6111
Epoch 300/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7923 - acc: 0.6556 - val_loss: 0.9097 - val_acc: 0.6111
Epoch 301/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7851 - acc: 0.6736 - val_loss: 0.9060 - val_acc: 0.6111
Epoch 302/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7762 - acc: 0.6681 - val_loss: 0.9052 - val_acc: 0.6111
Epoch 303/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7731 - acc: 0.6736 - val_loss: 0.9067 - val_acc: 0.6111
Epoch 304/3000
720/720 [==============================] - 0s 14us/step - loss: 0.8080 - acc: 0.6583 - val_loss: 0.9082 - val_acc: 0.6111
Epoch 305/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7958 - acc: 0.6764 - val_loss: 0.9104 - val_acc: 0.6111
Epoch 306/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7526 - acc: 0.6903 - val_loss: 0.9137 - val_acc: 0.6111
Epoch 307/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7768 - acc: 0.6556 - val_loss: 0.9174 - val_acc: 0.6111
Epoch 308/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7982 - acc: 0.6556 - val_loss: 0.9202 - val_acc: 0.6111
Epoch 309/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7886 - acc: 0.6542 - val_loss: 0.9211 - val_acc: 0.6111
Epoch 310/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7783 - acc: 0.6611 - val_loss: 0.9215 - val_acc: 0.6111
Epoch 311/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7553 - acc: 0.6792 - val_loss: 0.9198 - val_acc: 0.6111
Epoch 312/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7868 - acc: 0.6458 - val_loss: 0.9185 - val_acc: 0.6111
Epoch 313/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7962 - acc: 0.6597 - val_loss: 0.9121 - val_acc: 0.6056
Epoch 314/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7929 - acc: 0.6403 - val_loss: 0.9040 - val_acc: 0.6056
Epoch 315/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7901 - acc: 0.6486 - val_loss: 0.8928 - val_acc: 0.6000
Epoch 316/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7742 - acc: 0.6569 - val_loss: 0.8829 - val_acc: 0.6000
Epoch 317/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7727 - acc: 0.6653 - val_loss: 0.8711 - val_acc: 0.6000
Epoch 318/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7872 - acc: 0.6583 - val_loss: 0.8624 - val_acc: 0.6056
Epoch 319/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7741 - acc: 0.6792 - val_loss: 0.8541 - val_acc: 0.6056
Epoch 320/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7910 - acc: 0.6708 - val_loss: 0.8460 - val_acc: 0.6111
Epoch 321/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7765 - acc: 0.6583 - val_loss: 0.8370 - val_acc: 0.6111
Epoch 322/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7790 - acc: 0.6556 - val_loss: 0.8306 - val_acc: 0.6111
Epoch 323/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7888 - acc: 0.6708 - val_loss: 0.8249 - val_acc: 0.6111
Epoch 324/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7996 - acc: 0.6444 - val_loss: 0.8171 - val_acc: 0.6111
Epoch 325/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7803 - acc: 0.6722 - val_loss: 0.8119 - val_acc: 0.6333
Epoch 326/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7564 - acc: 0.6639 - val_loss: 0.8074 - val_acc: 0.6333
Epoch 327/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7711 - acc: 0.6750 - val_loss: 0.8045 - val_acc: 0.6333
Epoch 328/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7964 - acc: 0.6569 - val_loss: 0.8022 - val_acc: 0.6333
Epoch 329/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7605 - acc: 0.6681 - val_loss: 0.7996 - val_acc: 0.6333
Epoch 330/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7566 - acc: 0.6653 - val_loss: 0.7956 - val_acc: 0.6333
Epoch 331/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7783 - acc: 0.6792 - val_loss: 0.7923 - val_acc: 0.6389
Epoch 332/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7753 - acc: 0.6875 - val_loss: 0.7904 - val_acc: 0.6389
Epoch 333/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7807 - acc: 0.6708 - val_loss: 0.7915 - val_acc: 0.6389
Epoch 334/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7816 - acc: 0.6722 - val_loss: 0.7943 - val_acc: 0.6333
Epoch 335/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7606 - acc: 0.6736 - val_loss: 0.7982 - val_acc: 0.6333
Epoch 336/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7853 - acc: 0.6764 - val_loss: 0.8046 - val_acc: 0.6278
Epoch 337/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7861 - acc: 0.6639 - val_loss: 0.8087 - val_acc: 0.6278
Epoch 338/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7938 - acc: 0.6653 - val_loss: 0.8120 - val_acc: 0.6278
Epoch 339/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7972 - acc: 0.6528 - val_loss: 0.8138 - val_acc: 0.6278
Epoch 340/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7654 - acc: 0.6653 - val_loss: 0.8167 - val_acc: 0.6278
Epoch 341/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7706 - acc: 0.6694 - val_loss: 0.8183 - val_acc: 0.6278
Epoch 342/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7488 - acc: 0.6722 - val_loss: 0.8195 - val_acc: 0.6278
Epoch 343/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7567 - acc: 0.6750 - val_loss: 0.8220 - val_acc: 0.6278
Epoch 344/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7569 - acc: 0.6764 - val_loss: 0.8210 - val_acc: 0.6278
Epoch 345/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7762 - acc: 0.6764 - val_loss: 0.8193 - val_acc: 0.6278
Epoch 346/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7941 - acc: 0.6694 - val_loss: 0.8175 - val_acc: 0.6278
Epoch 347/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7648 - acc: 0.6667 - val_loss: 0.8156 - val_acc: 0.6278
Epoch 348/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7776 - acc: 0.6708 - val_loss: 0.8131 - val_acc: 0.6278
Epoch 349/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7966 - acc: 0.6458 - val_loss: 0.8088 - val_acc: 0.6278
Epoch 350/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7997 - acc: 0.6569 - val_loss: 0.8030 - val_acc: 0.6278
Epoch 351/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7772 - acc: 0.6778 - val_loss: 0.7988 - val_acc: 0.6278
Epoch 352/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7894 - acc: 0.6708 - val_loss: 0.7962 - val_acc: 0.6333
Epoch 353/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7758 - acc: 0.6736 - val_loss: 0.7949 - val_acc: 0.6333
Epoch 354/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7879 - acc: 0.6653 - val_loss: 0.7924 - val_acc: 0.6333
Epoch 355/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7621 - acc: 0.6750 - val_loss: 0.7888 - val_acc: 0.6278
Epoch 356/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7596 - acc: 0.6819 - val_loss: 0.7877 - val_acc: 0.6278
Epoch 357/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7941 - acc: 0.6722 - val_loss: 0.7884 - val_acc: 0.6333
Epoch 358/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7684 - acc: 0.6722 - val_loss: 0.7883 - val_acc: 0.6278
Epoch 359/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7820 - acc: 0.6306 - val_loss: 0.7890 - val_acc: 0.6333
Epoch 360/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7742 - acc: 0.6708 - val_loss: 0.7889 - val_acc: 0.6333
Epoch 361/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7799 - acc: 0.6556 - val_loss: 0.7897 - val_acc: 0.6333
Epoch 362/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7662 - acc: 0.6722 - val_loss: 0.7900 - val_acc: 0.6333
Epoch 363/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7599 - acc: 0.6861 - val_loss: 0.7887 - val_acc: 0.6333
Epoch 364/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7499 - acc: 0.6875 - val_loss: 0.7879 - val_acc: 0.6389
Epoch 365/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7687 - acc: 0.6708 - val_loss: 0.7868 - val_acc: 0.6389
Epoch 366/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7649 - acc: 0.6875 - val_loss: 0.7868 - val_acc: 0.6444
Epoch 367/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7758 - acc: 0.6764 - val_loss: 0.7848 - val_acc: 0.6444
Epoch 368/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7707 - acc: 0.6778 - val_loss: 0.7818 - val_acc: 0.6444
Epoch 369/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7821 - acc: 0.6667 - val_loss: 0.7799 - val_acc: 0.6444
Epoch 370/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7752 - acc: 0.6736 - val_loss: 0.7772 - val_acc: 0.6444
Epoch 371/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7662 - acc: 0.6708 - val_loss: 0.7754 - val_acc: 0.6444
Epoch 372/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7833 - acc: 0.6708 - val_loss: 0.7711 - val_acc: 0.6444
Epoch 373/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7789 - acc: 0.6681 - val_loss: 0.7667 - val_acc: 0.6444
Epoch 374/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7776 - acc: 0.6708 - val_loss: 0.7635 - val_acc: 0.6500
Epoch 375/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7760 - acc: 0.6819 - val_loss: 0.7607 - val_acc: 0.6556
Epoch 376/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7893 - acc: 0.6597 - val_loss: 0.7582 - val_acc: 0.6611
Epoch 377/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7857 - acc: 0.6778 - val_loss: 0.7570 - val_acc: 0.6611
Epoch 378/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7674 - acc: 0.6847 - val_loss: 0.7564 - val_acc: 0.6611
Epoch 379/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7719 - acc: 0.6819 - val_loss: 0.7545 - val_acc: 0.6611
Epoch 380/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7980 - acc: 0.6722 - val_loss: 0.7516 - val_acc: 0.6611
Epoch 381/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7646 - acc: 0.6681 - val_loss: 0.7502 - val_acc: 0.6667
Epoch 382/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7478 - acc: 0.6736 - val_loss: 0.7497 - val_acc: 0.6667
Epoch 383/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7696 - acc: 0.6833 - val_loss: 0.7476 - val_acc: 0.6611
Epoch 384/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7661 - acc: 0.6667 - val_loss: 0.7460 - val_acc: 0.6667
Epoch 385/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7514 - acc: 0.6694 - val_loss: 0.7447 - val_acc: 0.6611
Epoch 386/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7589 - acc: 0.6847 - val_loss: 0.7442 - val_acc: 0.6667
Epoch 387/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7752 - acc: 0.6708 - val_loss: 0.7425 - val_acc: 0.6667
Epoch 388/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7823 - acc: 0.6722 - val_loss: 0.7409 - val_acc: 0.6667
Epoch 389/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7778 - acc: 0.6653 - val_loss: 0.7398 - val_acc: 0.6667
Epoch 390/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7682 - acc: 0.6722 - val_loss: 0.7382 - val_acc: 0.6667
Epoch 391/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7869 - acc: 0.6431 - val_loss: 0.7365 - val_acc: 0.6667
Epoch 392/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7711 - acc: 0.6681 - val_loss: 0.7340 - val_acc: 0.6667
Epoch 393/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7644 - acc: 0.6556 - val_loss: 0.7328 - val_acc: 0.6722
Epoch 394/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7534 - acc: 0.6847 - val_loss: 0.7321 - val_acc: 0.6667
Epoch 395/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7910 - acc: 0.6583 - val_loss: 0.7319 - val_acc: 0.6722
Epoch 396/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7814 - acc: 0.6639 - val_loss: 0.7326 - val_acc: 0.6722
Epoch 397/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7831 - acc: 0.6681 - val_loss: 0.7332 - val_acc: 0.6722
Epoch 398/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7754 - acc: 0.6722 - val_loss: 0.7339 - val_acc: 0.6611
Epoch 399/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7695 - acc: 0.6847 - val_loss: 0.7346 - val_acc: 0.6611
Epoch 400/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7963 - acc: 0.6625 - val_loss: 0.7349 - val_acc: 0.6611
Epoch 401/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7827 - acc: 0.6639 - val_loss: 0.7353 - val_acc: 0.6611
Epoch 402/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7598 - acc: 0.6708 - val_loss: 0.7357 - val_acc: 0.6611
Epoch 403/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7613 - acc: 0.6736 - val_loss: 0.7363 - val_acc: 0.6722
Epoch 404/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7733 - acc: 0.6736 - val_loss: 0.7373 - val_acc: 0.6667
Epoch 405/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7666 - acc: 0.6639 - val_loss: 0.7389 - val_acc: 0.6667
Epoch 406/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7521 - acc: 0.6694 - val_loss: 0.7411 - val_acc: 0.6611
Epoch 407/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7658 - acc: 0.6875 - val_loss: 0.7434 - val_acc: 0.6667
Epoch 408/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7705 - acc: 0.6708 - val_loss: 0.7453 - val_acc: 0.6722
Epoch 409/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7438 - acc: 0.6792 - val_loss: 0.7474 - val_acc: 0.6722
Epoch 410/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7567 - acc: 0.6833 - val_loss: 0.7510 - val_acc: 0.6611
Epoch 411/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7592 - acc: 0.6681 - val_loss: 0.7548 - val_acc: 0.6611
Epoch 412/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7842 - acc: 0.6597 - val_loss: 0.7562 - val_acc: 0.6611
Epoch 413/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7675 - acc: 0.6722 - val_loss: 0.7559 - val_acc: 0.6611
Epoch 414/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7728 - acc: 0.6514 - val_loss: 0.7547 - val_acc: 0.6611
Epoch 415/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7279 - acc: 0.6792 - val_loss: 0.7538 - val_acc: 0.6611
Epoch 416/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7801 - acc: 0.6611 - val_loss: 0.7520 - val_acc: 0.6667
Epoch 417/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7790 - acc: 0.6681 - val_loss: 0.7475 - val_acc: 0.6667
Epoch 418/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7764 - acc: 0.6847 - val_loss: 0.7438 - val_acc: 0.6667
Epoch 419/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7489 - acc: 0.6778 - val_loss: 0.7409 - val_acc: 0.6611
Epoch 420/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7517 - acc: 0.6736 - val_loss: 0.7368 - val_acc: 0.6611
Epoch 421/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7808 - acc: 0.6597 - val_loss: 0.7345 - val_acc: 0.6722
Epoch 422/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7592 - acc: 0.6722 - val_loss: 0.7330 - val_acc: 0.6778
Epoch 423/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7637 - acc: 0.6681 - val_loss: 0.7320 - val_acc: 0.6778
Epoch 424/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7301 - acc: 0.6917 - val_loss: 0.7310 - val_acc: 0.6722
Epoch 425/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7485 - acc: 0.6722 - val_loss: 0.7302 - val_acc: 0.6833
Epoch 426/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7729 - acc: 0.6653 - val_loss: 0.7294 - val_acc: 0.6833
Epoch 427/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7632 - acc: 0.6653 - val_loss: 0.7289 - val_acc: 0.6833
Epoch 428/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7688 - acc: 0.6764 - val_loss: 0.7283 - val_acc: 0.6833
Epoch 429/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7597 - acc: 0.6625 - val_loss: 0.7276 - val_acc: 0.6833
Epoch 430/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7505 - acc: 0.6750 - val_loss: 0.7266 - val_acc: 0.6833
Epoch 431/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7535 - acc: 0.6833 - val_loss: 0.7254 - val_acc: 0.6833
Epoch 432/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7512 - acc: 0.6792 - val_loss: 0.7244 - val_acc: 0.6833
Epoch 433/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7594 - acc: 0.6764 - val_loss: 0.7234 - val_acc: 0.6833
Epoch 434/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7648 - acc: 0.6875 - val_loss: 0.7225 - val_acc: 0.6833
Epoch 435/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7530 - acc: 0.6792 - val_loss: 0.7218 - val_acc: 0.6833
Epoch 436/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7800 - acc: 0.6694 - val_loss: 0.7217 - val_acc: 0.6833
Epoch 437/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7812 - acc: 0.6625 - val_loss: 0.7219 - val_acc: 0.6778
Epoch 438/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7705 - acc: 0.6653 - val_loss: 0.7225 - val_acc: 0.6722
Epoch 439/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7769 - acc: 0.6681 - val_loss: 0.7239 - val_acc: 0.6722
Epoch 440/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7503 - acc: 0.6778 - val_loss: 0.7250 - val_acc: 0.6667
Epoch 441/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7611 - acc: 0.6806 - val_loss: 0.7261 - val_acc: 0.6667
Epoch 442/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7641 - acc: 0.6667 - val_loss: 0.7270 - val_acc: 0.6667
Epoch 443/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7509 - acc: 0.6667 - val_loss: 0.7274 - val_acc: 0.6667
Epoch 444/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7606 - acc: 0.6778 - val_loss: 0.7290 - val_acc: 0.6778
Epoch 445/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7621 - acc: 0.6736 - val_loss: 0.7295 - val_acc: 0.6778
Epoch 446/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7675 - acc: 0.6681 - val_loss: 0.7294 - val_acc: 0.6778
Epoch 447/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7596 - acc: 0.6875 - val_loss: 0.7288 - val_acc: 0.6778
Epoch 448/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7526 - acc: 0.6597 - val_loss: 0.7274 - val_acc: 0.6722
Epoch 449/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7641 - acc: 0.6625 - val_loss: 0.7261 - val_acc: 0.6778
Epoch 450/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7494 - acc: 0.6847 - val_loss: 0.7242 - val_acc: 0.6778
Epoch 451/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7648 - acc: 0.6861 - val_loss: 0.7218 - val_acc: 0.6889
Epoch 452/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7546 - acc: 0.6889 - val_loss: 0.7191 - val_acc: 0.6889
Epoch 453/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7475 - acc: 0.6722 - val_loss: 0.7169 - val_acc: 0.6833
Epoch 454/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7794 - acc: 0.6667 - val_loss: 0.7157 - val_acc: 0.6833
Epoch 455/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7611 - acc: 0.6625 - val_loss: 0.7153 - val_acc: 0.6722
Epoch 456/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7778 - acc: 0.6458 - val_loss: 0.7151 - val_acc: 0.6722
Epoch 457/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7727 - acc: 0.6806 - val_loss: 0.7148 - val_acc: 0.6722
Epoch 458/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7573 - acc: 0.6639 - val_loss: 0.7145 - val_acc: 0.6722
Epoch 459/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7748 - acc: 0.6694 - val_loss: 0.7146 - val_acc: 0.6722
Epoch 460/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7841 - acc: 0.6792 - val_loss: 0.7150 - val_acc: 0.6722
Epoch 461/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7687 - acc: 0.6819 - val_loss: 0.7154 - val_acc: 0.6833
Epoch 462/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7458 - acc: 0.6736 - val_loss: 0.7159 - val_acc: 0.6833
Epoch 463/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7622 - acc: 0.6639 - val_loss: 0.7167 - val_acc: 0.6833
Epoch 464/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7701 - acc: 0.6694 - val_loss: 0.7176 - val_acc: 0.6833
Epoch 465/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7676 - acc: 0.6792 - val_loss: 0.7185 - val_acc: 0.6833
Epoch 466/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7556 - acc: 0.6722 - val_loss: 0.7188 - val_acc: 0.6833
Epoch 467/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7638 - acc: 0.6764 - val_loss: 0.7191 - val_acc: 0.6833
Epoch 468/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7833 - acc: 0.6819 - val_loss: 0.7199 - val_acc: 0.6778
Epoch 469/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7805 - acc: 0.6639 - val_loss: 0.7212 - val_acc: 0.6833
Epoch 470/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7443 - acc: 0.6819 - val_loss: 0.7229 - val_acc: 0.6778
Epoch 471/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7478 - acc: 0.6792 - val_loss: 0.7247 - val_acc: 0.6778
Epoch 472/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7590 - acc: 0.6792 - val_loss: 0.7268 - val_acc: 0.6778
Epoch 473/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7576 - acc: 0.6681 - val_loss: 0.7294 - val_acc: 0.6778
Epoch 474/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7558 - acc: 0.6750 - val_loss: 0.7311 - val_acc: 0.6667
Epoch 475/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7519 - acc: 0.6792 - val_loss: 0.7330 - val_acc: 0.6667
Epoch 476/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7640 - acc: 0.6722 - val_loss: 0.7361 - val_acc: 0.6667
Epoch 477/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7472 - acc: 0.6847 - val_loss: 0.7367 - val_acc: 0.6667
Epoch 478/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7570 - acc: 0.6847 - val_loss: 0.7351 - val_acc: 0.6667
Epoch 479/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7621 - acc: 0.6681 - val_loss: 0.7317 - val_acc: 0.6667
Epoch 480/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7612 - acc: 0.6792 - val_loss: 0.7289 - val_acc: 0.6667
Epoch 481/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7654 - acc: 0.6778 - val_loss: 0.7258 - val_acc: 0.6667
Epoch 482/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7466 - acc: 0.6611 - val_loss: 0.7238 - val_acc: 0.6667
Epoch 483/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7514 - acc: 0.6806 - val_loss: 0.7217 - val_acc: 0.6778
Epoch 484/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7646 - acc: 0.6556 - val_loss: 0.7213 - val_acc: 0.6778
Epoch 485/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7703 - acc: 0.6792 - val_loss: 0.7202 - val_acc: 0.6778
Epoch 486/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7688 - acc: 0.6722 - val_loss: 0.7195 - val_acc: 0.6667
Epoch 487/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7432 - acc: 0.6722 - val_loss: 0.7186 - val_acc: 0.6722
Epoch 488/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7509 - acc: 0.6681 - val_loss: 0.7176 - val_acc: 0.6722
Epoch 489/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7565 - acc: 0.6972 - val_loss: 0.7168 - val_acc: 0.6833
Epoch 490/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7547 - acc: 0.6750 - val_loss: 0.7164 - val_acc: 0.6833
Epoch 491/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7611 - acc: 0.6764 - val_loss: 0.7163 - val_acc: 0.6833
Epoch 492/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7294 - acc: 0.6778 - val_loss: 0.7158 - val_acc: 0.6889
Epoch 493/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7522 - acc: 0.6764 - val_loss: 0.7154 - val_acc: 0.6833
Epoch 494/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7733 - acc: 0.6694 - val_loss: 0.7146 - val_acc: 0.6833
Epoch 495/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7745 - acc: 0.6694 - val_loss: 0.7142 - val_acc: 0.6833
Epoch 496/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7470 - acc: 0.6653 - val_loss: 0.7137 - val_acc: 0.6833
Epoch 497/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7464 - acc: 0.6847 - val_loss: 0.7131 - val_acc: 0.6833
Epoch 498/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7655 - acc: 0.6694 - val_loss: 0.7127 - val_acc: 0.6833
Epoch 499/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7394 - acc: 0.6750 - val_loss: 0.7124 - val_acc: 0.6833
Epoch 500/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7372 - acc: 0.6806 - val_loss: 0.7122 - val_acc: 0.6833
Epoch 501/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7400 - acc: 0.6722 - val_loss: 0.7115 - val_acc: 0.6833
Epoch 502/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7312 - acc: 0.6847 - val_loss: 0.7103 - val_acc: 0.6833
Epoch 503/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7568 - acc: 0.6694 - val_loss: 0.7087 - val_acc: 0.6889
Epoch 504/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7636 - acc: 0.6764 - val_loss: 0.7077 - val_acc: 0.6889
Epoch 505/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7643 - acc: 0.6861 - val_loss: 0.7080 - val_acc: 0.6889
Epoch 506/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7544 - acc: 0.6722 - val_loss: 0.7082 - val_acc: 0.6889
Epoch 507/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7310 - acc: 0.6847 - val_loss: 0.7086 - val_acc: 0.6889
Epoch 508/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7367 - acc: 0.6861 - val_loss: 0.7082 - val_acc: 0.6833
Epoch 509/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7542 - acc: 0.6833 - val_loss: 0.7086 - val_acc: 0.6889
Epoch 510/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7554 - acc: 0.6722 - val_loss: 0.7088 - val_acc: 0.6889
Epoch 511/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7339 - acc: 0.6708 - val_loss: 0.7091 - val_acc: 0.6889
Epoch 512/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7540 - acc: 0.6861 - val_loss: 0.7089 - val_acc: 0.6889
Epoch 513/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7636 - acc: 0.6611 - val_loss: 0.7077 - val_acc: 0.6889
Epoch 514/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7690 - acc: 0.6694 - val_loss: 0.7067 - val_acc: 0.6889
Epoch 515/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7375 - acc: 0.6931 - val_loss: 0.7064 - val_acc: 0.6889
Epoch 516/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7528 - acc: 0.6861 - val_loss: 0.7065 - val_acc: 0.6889
Epoch 517/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7431 - acc: 0.6778 - val_loss: 0.7077 - val_acc: 0.6889
Epoch 518/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7538 - acc: 0.6764 - val_loss: 0.7091 - val_acc: 0.6833
Epoch 519/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7776 - acc: 0.6722 - val_loss: 0.7105 - val_acc: 0.6833
Epoch 520/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7533 - acc: 0.6861 - val_loss: 0.7123 - val_acc: 0.6833
Epoch 521/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7506 - acc: 0.6833 - val_loss: 0.7137 - val_acc: 0.6833
Epoch 522/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7798 - acc: 0.6569 - val_loss: 0.7155 - val_acc: 0.6778
Epoch 523/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7593 - acc: 0.6764 - val_loss: 0.7186 - val_acc: 0.6833
Epoch 524/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7496 - acc: 0.6861 - val_loss: 0.7218 - val_acc: 0.6722
Epoch 525/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7437 - acc: 0.6931 - val_loss: 0.7251 - val_acc: 0.6667
Epoch 526/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7600 - acc: 0.6653 - val_loss: 0.7273 - val_acc: 0.6667
Epoch 527/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7554 - acc: 0.6708 - val_loss: 0.7288 - val_acc: 0.6722
Epoch 528/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7342 - acc: 0.6972 - val_loss: 0.7287 - val_acc: 0.6722
Epoch 529/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7422 - acc: 0.6792 - val_loss: 0.7280 - val_acc: 0.6833
Epoch 530/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7478 - acc: 0.6861 - val_loss: 0.7276 - val_acc: 0.6667
Epoch 531/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7582 - acc: 0.6792 - val_loss: 0.7272 - val_acc: 0.6667
Epoch 532/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7369 - acc: 0.6778 - val_loss: 0.7250 - val_acc: 0.6667
Epoch 533/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7413 - acc: 0.6944 - val_loss: 0.7234 - val_acc: 0.6611
Epoch 534/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7387 - acc: 0.7042 - val_loss: 0.7222 - val_acc: 0.6667
Epoch 535/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7618 - acc: 0.6708 - val_loss: 0.7207 - val_acc: 0.6667
Epoch 536/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7674 - acc: 0.6736 - val_loss: 0.7192 - val_acc: 0.6722
Epoch 537/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7690 - acc: 0.6819 - val_loss: 0.7184 - val_acc: 0.6722
Epoch 538/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7287 - acc: 0.6750 - val_loss: 0.7181 - val_acc: 0.6778
Epoch 539/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7483 - acc: 0.6972 - val_loss: 0.7185 - val_acc: 0.6778
Epoch 540/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7648 - acc: 0.6667 - val_loss: 0.7195 - val_acc: 0.6778
Epoch 541/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7637 - acc: 0.6764 - val_loss: 0.7218 - val_acc: 0.6667
Epoch 542/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7493 - acc: 0.6889 - val_loss: 0.7239 - val_acc: 0.6667
Epoch 543/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7517 - acc: 0.6708 - val_loss: 0.7259 - val_acc: 0.6722
Epoch 544/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7470 - acc: 0.6903 - val_loss: 0.7277 - val_acc: 0.6722
Epoch 545/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7550 - acc: 0.6833 - val_loss: 0.7295 - val_acc: 0.6667
Epoch 546/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7277 - acc: 0.6778 - val_loss: 0.7316 - val_acc: 0.6611
Epoch 547/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7659 - acc: 0.6792 - val_loss: 0.7339 - val_acc: 0.6611
Epoch 548/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7436 - acc: 0.6903 - val_loss: 0.7352 - val_acc: 0.6611
Epoch 549/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7513 - acc: 0.6958 - val_loss: 0.7366 - val_acc: 0.6611
Epoch 550/3000
720/720 [==============================] - 0s 38us/step - loss: 0.7341 - acc: 0.6778 - val_loss: 0.7375 - val_acc: 0.6611
Epoch 551/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7461 - acc: 0.6917 - val_loss: 0.7380 - val_acc: 0.6611
Epoch 552/3000
720/720 [==============================] - 0s 39us/step - loss: 0.7395 - acc: 0.6847 - val_loss: 0.7384 - val_acc: 0.6611
Epoch 553/3000
720/720 [==============================] - 0s 42us/step - loss: 0.7625 - acc: 0.6778 - val_loss: 0.7378 - val_acc: 0.6611
Epoch 554/3000
720/720 [==============================] - 0s 42us/step - loss: 0.7459 - acc: 0.6806 - val_loss: 0.7364 - val_acc: 0.6611
Epoch 555/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7655 - acc: 0.6903 - val_loss: 0.7343 - val_acc: 0.6667
Epoch 556/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7522 - acc: 0.6833 - val_loss: 0.7333 - val_acc: 0.6667
Epoch 557/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7629 - acc: 0.6722 - val_loss: 0.7322 - val_acc: 0.6667
Epoch 558/3000
720/720 [==============================] - 0s 33us/step - loss: 0.7668 - acc: 0.6736 - val_loss: 0.7311 - val_acc: 0.6667
Epoch 559/3000
720/720 [==============================] - 0s 47us/step - loss: 0.7368 - acc: 0.6861 - val_loss: 0.7302 - val_acc: 0.6667
Epoch 560/3000
720/720 [==============================] - 0s 40us/step - loss: 0.7559 - acc: 0.6764 - val_loss: 0.7285 - val_acc: 0.6667
Epoch 561/3000
720/720 [==============================] - 0s 42us/step - loss: 0.7419 - acc: 0.6792 - val_loss: 0.7265 - val_acc: 0.6667
Epoch 562/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7454 - acc: 0.6792 - val_loss: 0.7248 - val_acc: 0.6667
Epoch 563/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7611 - acc: 0.6708 - val_loss: 0.7234 - val_acc: 0.6667
Epoch 564/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7547 - acc: 0.6875 - val_loss: 0.7222 - val_acc: 0.6667
Epoch 565/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7438 - acc: 0.6792 - val_loss: 0.7208 - val_acc: 0.6722
Epoch 566/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7772 - acc: 0.6639 - val_loss: 0.7191 - val_acc: 0.6778
Epoch 567/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7532 - acc: 0.6819 - val_loss: 0.7181 - val_acc: 0.6778
Epoch 568/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7439 - acc: 0.6667 - val_loss: 0.7167 - val_acc: 0.6778
Epoch 569/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7616 - acc: 0.6736 - val_loss: 0.7154 - val_acc: 0.6833
Epoch 570/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7452 - acc: 0.6778 - val_loss: 0.7139 - val_acc: 0.6889
Epoch 571/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7462 - acc: 0.6764 - val_loss: 0.7127 - val_acc: 0.6889
Epoch 572/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7307 - acc: 0.6722 - val_loss: 0.7113 - val_acc: 0.6833
Epoch 573/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7332 - acc: 0.7056 - val_loss: 0.7100 - val_acc: 0.6833
Epoch 574/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7419 - acc: 0.6694 - val_loss: 0.7091 - val_acc: 0.6833
Epoch 575/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7544 - acc: 0.6861 - val_loss: 0.7081 - val_acc: 0.6833
Epoch 576/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7324 - acc: 0.6833 - val_loss: 0.7073 - val_acc: 0.6889
Epoch 577/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7793 - acc: 0.6667 - val_loss: 0.7063 - val_acc: 0.6889
Epoch 578/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7494 - acc: 0.6722 - val_loss: 0.7052 - val_acc: 0.6889
Epoch 579/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7251 - acc: 0.6889 - val_loss: 0.7044 - val_acc: 0.6889
Epoch 580/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7459 - acc: 0.6708 - val_loss: 0.7038 - val_acc: 0.6889
Epoch 581/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7355 - acc: 0.6889 - val_loss: 0.7033 - val_acc: 0.6889
Epoch 582/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7609 - acc: 0.6972 - val_loss: 0.7029 - val_acc: 0.6889
Epoch 583/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7553 - acc: 0.6722 - val_loss: 0.7028 - val_acc: 0.6889
Epoch 584/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7637 - acc: 0.6667 - val_loss: 0.7030 - val_acc: 0.6778
Epoch 585/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7374 - acc: 0.6847 - val_loss: 0.7040 - val_acc: 0.6778
Epoch 586/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7326 - acc: 0.6889 - val_loss: 0.7046 - val_acc: 0.6722
Epoch 587/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7398 - acc: 0.6722 - val_loss: 0.7055 - val_acc: 0.6833
Epoch 588/3000
720/720 [==============================] - 0s 21us/step - loss: 0.7341 - acc: 0.6806 - val_loss: 0.7071 - val_acc: 0.6833
Epoch 589/3000
720/720 [==============================] - 0s 39us/step - loss: 0.7549 - acc: 0.6958 - val_loss: 0.7086 - val_acc: 0.6833
Epoch 590/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7527 - acc: 0.6889 - val_loss: 0.7112 - val_acc: 0.6722
Epoch 591/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7400 - acc: 0.6875 - val_loss: 0.7145 - val_acc: 0.6722
Epoch 592/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7398 - acc: 0.6819 - val_loss: 0.7182 - val_acc: 0.6722
Epoch 593/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7473 - acc: 0.6833 - val_loss: 0.7231 - val_acc: 0.6722
Epoch 594/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7374 - acc: 0.6833 - val_loss: 0.7267 - val_acc: 0.6667
Epoch 595/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7400 - acc: 0.6903 - val_loss: 0.7311 - val_acc: 0.6667
Epoch 596/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7465 - acc: 0.6847 - val_loss: 0.7339 - val_acc: 0.6667
Epoch 597/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7468 - acc: 0.6736 - val_loss: 0.7342 - val_acc: 0.6667
Epoch 598/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7639 - acc: 0.6764 - val_loss: 0.7328 - val_acc: 0.6667
Epoch 599/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7414 - acc: 0.6833 - val_loss: 0.7306 - val_acc: 0.6667
Epoch 600/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7481 - acc: 0.6806 - val_loss: 0.7258 - val_acc: 0.6667
Epoch 601/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7597 - acc: 0.6681 - val_loss: 0.7209 - val_acc: 0.6778
Epoch 602/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7655 - acc: 0.6667 - val_loss: 0.7177 - val_acc: 0.6722
Epoch 603/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7586 - acc: 0.6722 - val_loss: 0.7150 - val_acc: 0.6778
Epoch 604/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7405 - acc: 0.6806 - val_loss: 0.7128 - val_acc: 0.6889
Epoch 605/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7308 - acc: 0.6917 - val_loss: 0.7116 - val_acc: 0.6889
Epoch 606/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7342 - acc: 0.6722 - val_loss: 0.7111 - val_acc: 0.6889
Epoch 607/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7482 - acc: 0.6889 - val_loss: 0.7108 - val_acc: 0.6889
Epoch 608/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7584 - acc: 0.6625 - val_loss: 0.7104 - val_acc: 0.6889
Epoch 609/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7464 - acc: 0.6750 - val_loss: 0.7098 - val_acc: 0.6889
Epoch 610/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7375 - acc: 0.6875 - val_loss: 0.7089 - val_acc: 0.6833
Epoch 611/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7392 - acc: 0.6833 - val_loss: 0.7079 - val_acc: 0.6833
Epoch 612/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7589 - acc: 0.6778 - val_loss: 0.7067 - val_acc: 0.6889
Epoch 613/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7381 - acc: 0.6736 - val_loss: 0.7056 - val_acc: 0.6833
Epoch 614/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7499 - acc: 0.6681 - val_loss: 0.7051 - val_acc: 0.6833
Epoch 615/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7622 - acc: 0.6708 - val_loss: 0.7049 - val_acc: 0.6833
Epoch 616/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7373 - acc: 0.6889 - val_loss: 0.7047 - val_acc: 0.6833
Epoch 617/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7503 - acc: 0.6792 - val_loss: 0.7047 - val_acc: 0.6833
Epoch 618/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7333 - acc: 0.6903 - val_loss: 0.7042 - val_acc: 0.6833
Epoch 619/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7369 - acc: 0.6792 - val_loss: 0.7036 - val_acc: 0.6833
Epoch 620/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7387 - acc: 0.6694 - val_loss: 0.7029 - val_acc: 0.6833
Epoch 621/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7392 - acc: 0.6708 - val_loss: 0.7022 - val_acc: 0.6833
Epoch 622/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7411 - acc: 0.6792 - val_loss: 0.7015 - val_acc: 0.6833
Epoch 623/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7387 - acc: 0.6833 - val_loss: 0.7016 - val_acc: 0.6889
Epoch 624/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7363 - acc: 0.6833 - val_loss: 0.7026 - val_acc: 0.6833
Epoch 625/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7146 - acc: 0.6917 - val_loss: 0.7038 - val_acc: 0.6778
Epoch 626/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7425 - acc: 0.6861 - val_loss: 0.7057 - val_acc: 0.6778
Epoch 627/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7319 - acc: 0.6736 - val_loss: 0.7080 - val_acc: 0.6667
Epoch 628/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7372 - acc: 0.6806 - val_loss: 0.7110 - val_acc: 0.6611
Epoch 629/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7206 - acc: 0.7000 - val_loss: 0.7150 - val_acc: 0.6611
Epoch 630/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7526 - acc: 0.6944 - val_loss: 0.7176 - val_acc: 0.6611
Epoch 631/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7418 - acc: 0.6722 - val_loss: 0.7191 - val_acc: 0.6611
Epoch 632/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7444 - acc: 0.6778 - val_loss: 0.7195 - val_acc: 0.6611
Epoch 633/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7447 - acc: 0.6792 - val_loss: 0.7188 - val_acc: 0.6667
Epoch 634/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7307 - acc: 0.6847 - val_loss: 0.7163 - val_acc: 0.6667
Epoch 635/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7649 - acc: 0.6722 - val_loss: 0.7137 - val_acc: 0.6667
Epoch 636/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7418 - acc: 0.6764 - val_loss: 0.7108 - val_acc: 0.6667
Epoch 637/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7433 - acc: 0.6875 - val_loss: 0.7078 - val_acc: 0.6778
Epoch 638/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7608 - acc: 0.6764 - val_loss: 0.7046 - val_acc: 0.6722
Epoch 639/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7200 - acc: 0.6917 - val_loss: 0.7025 - val_acc: 0.6722
Epoch 640/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7370 - acc: 0.6917 - val_loss: 0.7001 - val_acc: 0.6833
Epoch 641/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7366 - acc: 0.6875 - val_loss: 0.6983 - val_acc: 0.6889
Epoch 642/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7242 - acc: 0.6931 - val_loss: 0.6967 - val_acc: 0.6889
Epoch 643/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7392 - acc: 0.6833 - val_loss: 0.6963 - val_acc: 0.6889
Epoch 644/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7222 - acc: 0.6875 - val_loss: 0.6958 - val_acc: 0.6833
Epoch 645/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7218 - acc: 0.6889 - val_loss: 0.6953 - val_acc: 0.6833
Epoch 646/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7460 - acc: 0.6694 - val_loss: 0.6947 - val_acc: 0.6833
Epoch 647/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7347 - acc: 0.6833 - val_loss: 0.6943 - val_acc: 0.6833
Epoch 648/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7531 - acc: 0.6736 - val_loss: 0.6938 - val_acc: 0.6722
Epoch 649/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7241 - acc: 0.7056 - val_loss: 0.6935 - val_acc: 0.6722
Epoch 650/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7420 - acc: 0.6889 - val_loss: 0.6934 - val_acc: 0.6778
Epoch 651/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7239 - acc: 0.6694 - val_loss: 0.6936 - val_acc: 0.6722
Epoch 652/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7414 - acc: 0.6750 - val_loss: 0.6937 - val_acc: 0.6722
Epoch 653/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7298 - acc: 0.6861 - val_loss: 0.6940 - val_acc: 0.6778
Epoch 654/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7384 - acc: 0.6958 - val_loss: 0.6941 - val_acc: 0.6778
Epoch 655/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7361 - acc: 0.6889 - val_loss: 0.6946 - val_acc: 0.6833
Epoch 656/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7553 - acc: 0.6847 - val_loss: 0.6953 - val_acc: 0.6889
Epoch 657/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7218 - acc: 0.6944 - val_loss: 0.6958 - val_acc: 0.6889
Epoch 658/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7414 - acc: 0.6861 - val_loss: 0.6963 - val_acc: 0.6889
Epoch 659/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7304 - acc: 0.7028 - val_loss: 0.6962 - val_acc: 0.6889
Epoch 660/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7362 - acc: 0.6819 - val_loss: 0.6959 - val_acc: 0.6889
Epoch 661/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7571 - acc: 0.6917 - val_loss: 0.6958 - val_acc: 0.6889
Epoch 662/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7286 - acc: 0.6944 - val_loss: 0.6954 - val_acc: 0.6889
Epoch 663/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7461 - acc: 0.6764 - val_loss: 0.6956 - val_acc: 0.6833
Epoch 664/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7210 - acc: 0.6819 - val_loss: 0.6962 - val_acc: 0.6778
Epoch 665/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7527 - acc: 0.6806 - val_loss: 0.6963 - val_acc: 0.6722
Epoch 666/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7478 - acc: 0.6861 - val_loss: 0.6971 - val_acc: 0.6722
Epoch 667/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7192 - acc: 0.6847 - val_loss: 0.6990 - val_acc: 0.6778
Epoch 668/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7315 - acc: 0.6722 - val_loss: 0.7016 - val_acc: 0.6778
Epoch 669/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7250 - acc: 0.6944 - val_loss: 0.7028 - val_acc: 0.6778
Epoch 670/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7471 - acc: 0.6847 - val_loss: 0.7031 - val_acc: 0.6778
Epoch 671/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7379 - acc: 0.6778 - val_loss: 0.7032 - val_acc: 0.6722
Epoch 672/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7116 - acc: 0.6972 - val_loss: 0.7020 - val_acc: 0.6722
Epoch 673/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7391 - acc: 0.6819 - val_loss: 0.7013 - val_acc: 0.6722
Epoch 674/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7331 - acc: 0.6931 - val_loss: 0.7003 - val_acc: 0.6722
Epoch 675/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7432 - acc: 0.6875 - val_loss: 0.6986 - val_acc: 0.6722
Epoch 676/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7473 - acc: 0.6736 - val_loss: 0.6966 - val_acc: 0.6778
Epoch 677/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7385 - acc: 0.6833 - val_loss: 0.6947 - val_acc: 0.6889
Epoch 678/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7382 - acc: 0.6972 - val_loss: 0.6931 - val_acc: 0.6889
Epoch 679/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7375 - acc: 0.6917 - val_loss: 0.6921 - val_acc: 0.6889
Epoch 680/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7535 - acc: 0.6764 - val_loss: 0.6917 - val_acc: 0.6889
Epoch 681/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7122 - acc: 0.6847 - val_loss: 0.6914 - val_acc: 0.6944
Epoch 682/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7520 - acc: 0.6792 - val_loss: 0.6913 - val_acc: 0.6833
Epoch 683/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7589 - acc: 0.6778 - val_loss: 0.6914 - val_acc: 0.6833
Epoch 684/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7625 - acc: 0.6778 - val_loss: 0.6915 - val_acc: 0.6833
Epoch 685/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7253 - acc: 0.6986 - val_loss: 0.6918 - val_acc: 0.6833
Epoch 686/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7478 - acc: 0.6875 - val_loss: 0.6921 - val_acc: 0.6833
Epoch 687/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7459 - acc: 0.6875 - val_loss: 0.6922 - val_acc: 0.6833
Epoch 688/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7451 - acc: 0.6722 - val_loss: 0.6919 - val_acc: 0.6833
Epoch 689/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7401 - acc: 0.6833 - val_loss: 0.6919 - val_acc: 0.6833
Epoch 690/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7297 - acc: 0.6875 - val_loss: 0.6918 - val_acc: 0.6833
Epoch 691/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7426 - acc: 0.6750 - val_loss: 0.6921 - val_acc: 0.6833
Epoch 692/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7378 - acc: 0.6847 - val_loss: 0.6926 - val_acc: 0.6944
Epoch 693/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7590 - acc: 0.6833 - val_loss: 0.6937 - val_acc: 0.6944
Epoch 694/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7364 - acc: 0.6986 - val_loss: 0.6952 - val_acc: 0.6889
Epoch 695/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7412 - acc: 0.6819 - val_loss: 0.6968 - val_acc: 0.6833
Epoch 696/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7583 - acc: 0.6778 - val_loss: 0.6980 - val_acc: 0.6833
Epoch 697/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7511 - acc: 0.6792 - val_loss: 0.6997 - val_acc: 0.6778
Epoch 698/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7263 - acc: 0.7028 - val_loss: 0.7008 - val_acc: 0.6833
Epoch 699/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7198 - acc: 0.6889 - val_loss: 0.7019 - val_acc: 0.6833
Epoch 700/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7345 - acc: 0.6903 - val_loss: 0.7023 - val_acc: 0.6833
Epoch 701/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7379 - acc: 0.6875 - val_loss: 0.7024 - val_acc: 0.6833
Epoch 702/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7301 - acc: 0.6764 - val_loss: 0.7016 - val_acc: 0.6833
Epoch 703/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7493 - acc: 0.6875 - val_loss: 0.7017 - val_acc: 0.6778
Epoch 704/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7293 - acc: 0.6889 - val_loss: 0.7018 - val_acc: 0.6778
Epoch 705/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7474 - acc: 0.6708 - val_loss: 0.7020 - val_acc: 0.6778
Epoch 706/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7348 - acc: 0.6944 - val_loss: 0.7020 - val_acc: 0.6778
Epoch 707/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7244 - acc: 0.6889 - val_loss: 0.7021 - val_acc: 0.6833
Epoch 708/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7357 - acc: 0.6847 - val_loss: 0.7019 - val_acc: 0.6833
Epoch 709/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7319 - acc: 0.7083 - val_loss: 0.7018 - val_acc: 0.6833
Epoch 710/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7126 - acc: 0.7014 - val_loss: 0.7015 - val_acc: 0.6833
Epoch 711/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7252 - acc: 0.6806 - val_loss: 0.7014 - val_acc: 0.6778
Epoch 712/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7200 - acc: 0.6889 - val_loss: 0.7019 - val_acc: 0.6833
Epoch 713/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7232 - acc: 0.6708 - val_loss: 0.7018 - val_acc: 0.6833
Epoch 714/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7524 - acc: 0.6944 - val_loss: 0.7016 - val_acc: 0.6833
Epoch 715/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7357 - acc: 0.6806 - val_loss: 0.7012 - val_acc: 0.6833
Epoch 716/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7331 - acc: 0.6931 - val_loss: 0.7008 - val_acc: 0.6833
Epoch 717/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7326 - acc: 0.6778 - val_loss: 0.7007 - val_acc: 0.6944
Epoch 718/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7085 - acc: 0.7014 - val_loss: 0.7007 - val_acc: 0.6944
Epoch 719/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7400 - acc: 0.6944 - val_loss: 0.7008 - val_acc: 0.6944
Epoch 720/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7404 - acc: 0.7028 - val_loss: 0.7009 - val_acc: 0.6944
Epoch 721/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7215 - acc: 0.6889 - val_loss: 0.7004 - val_acc: 0.6944
Epoch 722/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7179 - acc: 0.6861 - val_loss: 0.7004 - val_acc: 0.6944
Epoch 723/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7257 - acc: 0.6944 - val_loss: 0.7005 - val_acc: 0.6944
Epoch 724/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7417 - acc: 0.6889 - val_loss: 0.7003 - val_acc: 0.6944
Epoch 725/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7260 - acc: 0.6903 - val_loss: 0.6996 - val_acc: 0.6944
Epoch 726/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7396 - acc: 0.6833 - val_loss: 0.6990 - val_acc: 0.6889
Epoch 727/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7518 - acc: 0.6958 - val_loss: 0.6989 - val_acc: 0.6944
Epoch 728/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7344 - acc: 0.6861 - val_loss: 0.6984 - val_acc: 0.6944
Epoch 729/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7371 - acc: 0.6833 - val_loss: 0.6978 - val_acc: 0.7000
Epoch 730/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7467 - acc: 0.6875 - val_loss: 0.6972 - val_acc: 0.7000
Epoch 731/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7347 - acc: 0.6917 - val_loss: 0.6970 - val_acc: 0.7000
Epoch 732/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7632 - acc: 0.6778 - val_loss: 0.6969 - val_acc: 0.7000
Epoch 733/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7157 - acc: 0.7111 - val_loss: 0.6964 - val_acc: 0.7000
Epoch 734/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7304 - acc: 0.7000 - val_loss: 0.6959 - val_acc: 0.7000
Epoch 735/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7199 - acc: 0.7014 - val_loss: 0.6955 - val_acc: 0.7000
Epoch 736/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7576 - acc: 0.6944 - val_loss: 0.6955 - val_acc: 0.6944
Epoch 737/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7416 - acc: 0.6903 - val_loss: 0.6956 - val_acc: 0.6944
Epoch 738/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7429 - acc: 0.6889 - val_loss: 0.6955 - val_acc: 0.6944
Epoch 739/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7478 - acc: 0.6861 - val_loss: 0.6955 - val_acc: 0.6944
Epoch 740/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7374 - acc: 0.6764 - val_loss: 0.6959 - val_acc: 0.6944
Epoch 741/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7446 - acc: 0.6667 - val_loss: 0.6962 - val_acc: 0.7000
Epoch 742/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7324 - acc: 0.6708 - val_loss: 0.6964 - val_acc: 0.7000
Epoch 743/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7177 - acc: 0.6847 - val_loss: 0.6967 - val_acc: 0.7000
Epoch 744/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7307 - acc: 0.6917 - val_loss: 0.6969 - val_acc: 0.7000
Epoch 745/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7375 - acc: 0.6750 - val_loss: 0.6977 - val_acc: 0.7000
Epoch 746/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7378 - acc: 0.6750 - val_loss: 0.6988 - val_acc: 0.7000
Epoch 747/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7471 - acc: 0.6875 - val_loss: 0.7007 - val_acc: 0.6944
Epoch 748/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7386 - acc: 0.6847 - val_loss: 0.7028 - val_acc: 0.6889
Epoch 749/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7334 - acc: 0.6917 - val_loss: 0.7052 - val_acc: 0.6833
Epoch 750/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7350 - acc: 0.6903 - val_loss: 0.7077 - val_acc: 0.6778
Epoch 751/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7402 - acc: 0.6875 - val_loss: 0.7102 - val_acc: 0.6778
Epoch 752/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7490 - acc: 0.6806 - val_loss: 0.7114 - val_acc: 0.6778
Epoch 753/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7393 - acc: 0.6819 - val_loss: 0.7109 - val_acc: 0.6778
Epoch 754/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7317 - acc: 0.6806 - val_loss: 0.7110 - val_acc: 0.6778
Epoch 755/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7505 - acc: 0.6708 - val_loss: 0.7099 - val_acc: 0.6778
Epoch 756/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7287 - acc: 0.6792 - val_loss: 0.7085 - val_acc: 0.6778
Epoch 757/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7393 - acc: 0.6972 - val_loss: 0.7071 - val_acc: 0.6778
Epoch 758/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7504 - acc: 0.6722 - val_loss: 0.7052 - val_acc: 0.6833
Epoch 759/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7339 - acc: 0.6958 - val_loss: 0.7027 - val_acc: 0.6889
Epoch 760/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7138 - acc: 0.6903 - val_loss: 0.7014 - val_acc: 0.6944
Epoch 761/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7470 - acc: 0.6806 - val_loss: 0.7002 - val_acc: 0.7000
Epoch 762/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7191 - acc: 0.6861 - val_loss: 0.6996 - val_acc: 0.7000
Epoch 763/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7420 - acc: 0.6806 - val_loss: 0.6992 - val_acc: 0.7000
Epoch 764/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7070 - acc: 0.6931 - val_loss: 0.6992 - val_acc: 0.7056
Epoch 765/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7314 - acc: 0.6889 - val_loss: 0.6991 - val_acc: 0.7056
Epoch 766/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7389 - acc: 0.6833 - val_loss: 0.6989 - val_acc: 0.7056
Epoch 767/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7340 - acc: 0.6917 - val_loss: 0.6987 - val_acc: 0.7056
Epoch 768/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7365 - acc: 0.6903 - val_loss: 0.6984 - val_acc: 0.7056
Epoch 769/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7463 - acc: 0.6778 - val_loss: 0.6979 - val_acc: 0.7000
Epoch 770/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7282 - acc: 0.6889 - val_loss: 0.6978 - val_acc: 0.7000
Epoch 771/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7230 - acc: 0.7083 - val_loss: 0.6977 - val_acc: 0.7000
Epoch 772/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7147 - acc: 0.6875 - val_loss: 0.6976 - val_acc: 0.7000
Epoch 773/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7228 - acc: 0.6875 - val_loss: 0.6971 - val_acc: 0.7000
Epoch 774/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7329 - acc: 0.6806 - val_loss: 0.6968 - val_acc: 0.7000
Epoch 775/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7166 - acc: 0.6972 - val_loss: 0.6965 - val_acc: 0.7000
Epoch 776/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7637 - acc: 0.6833 - val_loss: 0.6960 - val_acc: 0.7000
Epoch 777/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7350 - acc: 0.7069 - val_loss: 0.6956 - val_acc: 0.7000
Epoch 778/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7337 - acc: 0.6764 - val_loss: 0.6951 - val_acc: 0.7000
Epoch 779/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7269 - acc: 0.6986 - val_loss: 0.6946 - val_acc: 0.7000
Epoch 780/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7272 - acc: 0.6903 - val_loss: 0.6942 - val_acc: 0.7000
Epoch 781/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7215 - acc: 0.6958 - val_loss: 0.6941 - val_acc: 0.7000
Epoch 782/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7154 - acc: 0.6944 - val_loss: 0.6939 - val_acc: 0.6944
Epoch 783/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7228 - acc: 0.7014 - val_loss: 0.6940 - val_acc: 0.6944
Epoch 784/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7464 - acc: 0.6764 - val_loss: 0.6940 - val_acc: 0.6944
Epoch 785/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7545 - acc: 0.6903 - val_loss: 0.6940 - val_acc: 0.6944
Epoch 786/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7276 - acc: 0.7042 - val_loss: 0.6942 - val_acc: 0.6944
Epoch 787/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7433 - acc: 0.6972 - val_loss: 0.6943 - val_acc: 0.6944
Epoch 788/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7328 - acc: 0.6903 - val_loss: 0.6949 - val_acc: 0.6944
Epoch 789/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7346 - acc: 0.6944 - val_loss: 0.6952 - val_acc: 0.7000
Epoch 790/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7328 - acc: 0.7014 - val_loss: 0.6955 - val_acc: 0.7000
Epoch 791/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7227 - acc: 0.6986 - val_loss: 0.6956 - val_acc: 0.7000
Epoch 792/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7209 - acc: 0.6931 - val_loss: 0.6956 - val_acc: 0.6944
Epoch 793/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7624 - acc: 0.6764 - val_loss: 0.6953 - val_acc: 0.6944
Epoch 794/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7332 - acc: 0.6944 - val_loss: 0.6948 - val_acc: 0.6944
Epoch 795/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7180 - acc: 0.6944 - val_loss: 0.6939 - val_acc: 0.6944
Epoch 796/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6943 - acc: 0.7014 - val_loss: 0.6931 - val_acc: 0.7000
Epoch 797/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7273 - acc: 0.7028 - val_loss: 0.6922 - val_acc: 0.7056
Epoch 798/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7552 - acc: 0.6806 - val_loss: 0.6913 - val_acc: 0.7056
Epoch 799/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7216 - acc: 0.6931 - val_loss: 0.6907 - val_acc: 0.7056
Epoch 800/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7284 - acc: 0.6875 - val_loss: 0.6900 - val_acc: 0.7056
Epoch 801/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7504 - acc: 0.6861 - val_loss: 0.6892 - val_acc: 0.7000
Epoch 802/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7194 - acc: 0.6903 - val_loss: 0.6888 - val_acc: 0.7000
Epoch 803/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7461 - acc: 0.6667 - val_loss: 0.6886 - val_acc: 0.6944
Epoch 804/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7150 - acc: 0.6917 - val_loss: 0.6886 - val_acc: 0.6944
Epoch 805/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7328 - acc: 0.6875 - val_loss: 0.6890 - val_acc: 0.6889
Epoch 806/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7428 - acc: 0.6806 - val_loss: 0.6890 - val_acc: 0.6833
Epoch 807/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7295 - acc: 0.7069 - val_loss: 0.6890 - val_acc: 0.6778
Epoch 808/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7303 - acc: 0.6875 - val_loss: 0.6886 - val_acc: 0.6833
Epoch 809/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7237 - acc: 0.6903 - val_loss: 0.6880 - val_acc: 0.6944
Epoch 810/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7372 - acc: 0.6806 - val_loss: 0.6871 - val_acc: 0.6944
Epoch 811/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7183 - acc: 0.6931 - val_loss: 0.6864 - val_acc: 0.7000
Epoch 812/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7386 - acc: 0.6972 - val_loss: 0.6855 - val_acc: 0.7000
Epoch 813/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7146 - acc: 0.6931 - val_loss: 0.6850 - val_acc: 0.7000
Epoch 814/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7394 - acc: 0.6750 - val_loss: 0.6852 - val_acc: 0.7000
Epoch 815/3000
720/720 [==============================] - 0s 42us/step - loss: 0.7178 - acc: 0.7014 - val_loss: 0.6849 - val_acc: 0.7000
Epoch 816/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7190 - acc: 0.6917 - val_loss: 0.6847 - val_acc: 0.7000
Epoch 817/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7148 - acc: 0.6972 - val_loss: 0.6845 - val_acc: 0.7000
Epoch 818/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7153 - acc: 0.7042 - val_loss: 0.6843 - val_acc: 0.7000
Epoch 819/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7400 - acc: 0.6861 - val_loss: 0.6844 - val_acc: 0.7056
Epoch 820/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7263 - acc: 0.6958 - val_loss: 0.6841 - val_acc: 0.7056
Epoch 821/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7360 - acc: 0.6903 - val_loss: 0.6840 - val_acc: 0.7056
Epoch 822/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7452 - acc: 0.6861 - val_loss: 0.6839 - val_acc: 0.7000
Epoch 823/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7461 - acc: 0.6861 - val_loss: 0.6837 - val_acc: 0.7000
Epoch 824/3000
720/720 [==============================] - 0s 50us/step - loss: 0.7486 - acc: 0.6889 - val_loss: 0.6833 - val_acc: 0.7000
Epoch 825/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7265 - acc: 0.6972 - val_loss: 0.6829 - val_acc: 0.6944
Epoch 826/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7410 - acc: 0.6806 - val_loss: 0.6827 - val_acc: 0.7000
Epoch 827/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7480 - acc: 0.6861 - val_loss: 0.6829 - val_acc: 0.7056
Epoch 828/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7147 - acc: 0.6847 - val_loss: 0.6831 - val_acc: 0.7000
Epoch 829/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7227 - acc: 0.6931 - val_loss: 0.6835 - val_acc: 0.7000
Epoch 830/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7209 - acc: 0.6889 - val_loss: 0.6841 - val_acc: 0.7000
Epoch 831/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7116 - acc: 0.6917 - val_loss: 0.6849 - val_acc: 0.7000
Epoch 832/3000
720/720 [==============================] - 0s 21us/step - loss: 0.7344 - acc: 0.6903 - val_loss: 0.6859 - val_acc: 0.7000
Epoch 833/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7154 - acc: 0.7069 - val_loss: 0.6869 - val_acc: 0.7000
Epoch 834/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7234 - acc: 0.6972 - val_loss: 0.6872 - val_acc: 0.7000
Epoch 835/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7167 - acc: 0.6958 - val_loss: 0.6876 - val_acc: 0.6944
Epoch 836/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7183 - acc: 0.6986 - val_loss: 0.6884 - val_acc: 0.7000
Epoch 837/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7236 - acc: 0.6944 - val_loss: 0.6898 - val_acc: 0.6889
Epoch 838/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7243 - acc: 0.6764 - val_loss: 0.6919 - val_acc: 0.6833
Epoch 839/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7132 - acc: 0.6972 - val_loss: 0.6937 - val_acc: 0.6778
Epoch 840/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7235 - acc: 0.7042 - val_loss: 0.6955 - val_acc: 0.6778
Epoch 841/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7347 - acc: 0.6847 - val_loss: 0.6971 - val_acc: 0.6778
Epoch 842/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7195 - acc: 0.7069 - val_loss: 0.6984 - val_acc: 0.6722
Epoch 843/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7297 - acc: 0.6819 - val_loss: 0.6976 - val_acc: 0.6778
Epoch 844/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7266 - acc: 0.6847 - val_loss: 0.6958 - val_acc: 0.6778
Epoch 845/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7489 - acc: 0.6819 - val_loss: 0.6931 - val_acc: 0.6778
Epoch 846/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7089 - acc: 0.6792 - val_loss: 0.6907 - val_acc: 0.6833
Epoch 847/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7507 - acc: 0.6778 - val_loss: 0.6886 - val_acc: 0.6944
Epoch 848/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7199 - acc: 0.6958 - val_loss: 0.6873 - val_acc: 0.6944
Epoch 849/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7184 - acc: 0.6833 - val_loss: 0.6865 - val_acc: 0.7000
Epoch 850/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7138 - acc: 0.7042 - val_loss: 0.6863 - val_acc: 0.7056
Epoch 851/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7461 - acc: 0.6639 - val_loss: 0.6864 - val_acc: 0.7056
Epoch 852/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7439 - acc: 0.6833 - val_loss: 0.6862 - val_acc: 0.7000
Epoch 853/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7351 - acc: 0.6931 - val_loss: 0.6860 - val_acc: 0.7056
Epoch 854/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7277 - acc: 0.7014 - val_loss: 0.6855 - val_acc: 0.7056
Epoch 855/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7455 - acc: 0.6847 - val_loss: 0.6849 - val_acc: 0.7056
Epoch 856/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7293 - acc: 0.7056 - val_loss: 0.6846 - val_acc: 0.7056
Epoch 857/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7207 - acc: 0.6819 - val_loss: 0.6842 - val_acc: 0.7056
Epoch 858/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7202 - acc: 0.7056 - val_loss: 0.6837 - val_acc: 0.7056
Epoch 859/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7108 - acc: 0.6903 - val_loss: 0.6837 - val_acc: 0.7056
Epoch 860/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7004 - acc: 0.6917 - val_loss: 0.6839 - val_acc: 0.7056
Epoch 861/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7110 - acc: 0.6958 - val_loss: 0.6842 - val_acc: 0.7056
Epoch 862/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7085 - acc: 0.6958 - val_loss: 0.6853 - val_acc: 0.7056
Epoch 863/3000
720/720 [==============================] - 0s 21us/step - loss: 0.7028 - acc: 0.6931 - val_loss: 0.6861 - val_acc: 0.7056
Epoch 864/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7352 - acc: 0.6917 - val_loss: 0.6861 - val_acc: 0.7056
Epoch 865/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7181 - acc: 0.6889 - val_loss: 0.6856 - val_acc: 0.7000
Epoch 866/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7058 - acc: 0.6917 - val_loss: 0.6850 - val_acc: 0.7000
Epoch 867/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7150 - acc: 0.6819 - val_loss: 0.6846 - val_acc: 0.6944
Epoch 868/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7262 - acc: 0.6958 - val_loss: 0.6845 - val_acc: 0.6944
Epoch 869/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7295 - acc: 0.6833 - val_loss: 0.6845 - val_acc: 0.7000
Epoch 870/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7328 - acc: 0.6889 - val_loss: 0.6845 - val_acc: 0.7000
Epoch 871/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7260 - acc: 0.6944 - val_loss: 0.6844 - val_acc: 0.7000
Epoch 872/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7258 - acc: 0.6972 - val_loss: 0.6846 - val_acc: 0.7000
Epoch 873/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7229 - acc: 0.7042 - val_loss: 0.6849 - val_acc: 0.7000
Epoch 874/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7402 - acc: 0.6861 - val_loss: 0.6851 - val_acc: 0.6944
Epoch 875/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7226 - acc: 0.6958 - val_loss: 0.6851 - val_acc: 0.6944
Epoch 876/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7273 - acc: 0.6875 - val_loss: 0.6851 - val_acc: 0.6944
Epoch 877/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7355 - acc: 0.6903 - val_loss: 0.6850 - val_acc: 0.6944
Epoch 878/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7171 - acc: 0.6833 - val_loss: 0.6846 - val_acc: 0.6944
Epoch 879/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7279 - acc: 0.7069 - val_loss: 0.6838 - val_acc: 0.6944
Epoch 880/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7104 - acc: 0.7069 - val_loss: 0.6833 - val_acc: 0.7000
Epoch 881/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7304 - acc: 0.7000 - val_loss: 0.6828 - val_acc: 0.7000
Epoch 882/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7145 - acc: 0.6972 - val_loss: 0.6824 - val_acc: 0.7000
Epoch 883/3000
720/720 [==============================] - 0s 50us/step - loss: 0.7363 - acc: 0.6778 - val_loss: 0.6826 - val_acc: 0.7000
Epoch 884/3000
720/720 [==============================] - 0s 43us/step - loss: 0.7112 - acc: 0.7042 - val_loss: 0.6829 - val_acc: 0.7000
Epoch 885/3000
720/720 [==============================] - 0s 33us/step - loss: 0.7475 - acc: 0.6847 - val_loss: 0.6829 - val_acc: 0.7000
Epoch 886/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7213 - acc: 0.6903 - val_loss: 0.6834 - val_acc: 0.6944
Epoch 887/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7229 - acc: 0.6917 - val_loss: 0.6839 - val_acc: 0.6944
Epoch 888/3000
720/720 [==============================] - 0s 36us/step - loss: 0.7158 - acc: 0.7014 - val_loss: 0.6842 - val_acc: 0.6944
Epoch 889/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7050 - acc: 0.6931 - val_loss: 0.6839 - val_acc: 0.6944
Epoch 890/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7185 - acc: 0.6972 - val_loss: 0.6841 - val_acc: 0.7000
Epoch 891/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7136 - acc: 0.6931 - val_loss: 0.6832 - val_acc: 0.7000
Epoch 892/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7071 - acc: 0.7083 - val_loss: 0.6820 - val_acc: 0.7111
Epoch 893/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7203 - acc: 0.6875 - val_loss: 0.6814 - val_acc: 0.7111
Epoch 894/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6939 - acc: 0.7028 - val_loss: 0.6808 - val_acc: 0.7056
Epoch 895/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7179 - acc: 0.7000 - val_loss: 0.6809 - val_acc: 0.7056
Epoch 896/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7419 - acc: 0.6806 - val_loss: 0.6811 - val_acc: 0.7111
Epoch 897/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7418 - acc: 0.6889 - val_loss: 0.6812 - val_acc: 0.7056
Epoch 898/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7263 - acc: 0.6931 - val_loss: 0.6807 - val_acc: 0.7056
Epoch 899/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7193 - acc: 0.6972 - val_loss: 0.6801 - val_acc: 0.7056
Epoch 900/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7180 - acc: 0.6931 - val_loss: 0.6794 - val_acc: 0.7111
Epoch 901/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7404 - acc: 0.6958 - val_loss: 0.6788 - val_acc: 0.7167
Epoch 902/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7241 - acc: 0.6931 - val_loss: 0.6782 - val_acc: 0.7167
Epoch 903/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6973 - acc: 0.7014 - val_loss: 0.6780 - val_acc: 0.7111
Epoch 904/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7246 - acc: 0.6958 - val_loss: 0.6780 - val_acc: 0.7111
Epoch 905/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7354 - acc: 0.6708 - val_loss: 0.6785 - val_acc: 0.7056
Epoch 906/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7185 - acc: 0.6903 - val_loss: 0.6795 - val_acc: 0.7000
Epoch 907/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7094 - acc: 0.6944 - val_loss: 0.6807 - val_acc: 0.6944
Epoch 908/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7231 - acc: 0.6889 - val_loss: 0.6823 - val_acc: 0.6889
Epoch 909/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7061 - acc: 0.7000 - val_loss: 0.6839 - val_acc: 0.6889
Epoch 910/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7075 - acc: 0.6972 - val_loss: 0.6851 - val_acc: 0.6889
Epoch 911/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7094 - acc: 0.7069 - val_loss: 0.6861 - val_acc: 0.6889
Epoch 912/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7120 - acc: 0.7097 - val_loss: 0.6867 - val_acc: 0.6889
Epoch 913/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7220 - acc: 0.6944 - val_loss: 0.6868 - val_acc: 0.6889
Epoch 914/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7257 - acc: 0.6917 - val_loss: 0.6870 - val_acc: 0.6889
Epoch 915/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7314 - acc: 0.6819 - val_loss: 0.6872 - val_acc: 0.6889
Epoch 916/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7450 - acc: 0.6833 - val_loss: 0.6876 - val_acc: 0.6889
Epoch 917/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7278 - acc: 0.6972 - val_loss: 0.6869 - val_acc: 0.6944
Epoch 918/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6999 - acc: 0.6889 - val_loss: 0.6867 - val_acc: 0.6944
Epoch 919/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7175 - acc: 0.6875 - val_loss: 0.6868 - val_acc: 0.6944
Epoch 920/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7082 - acc: 0.6944 - val_loss: 0.6867 - val_acc: 0.7000
Epoch 921/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7014 - acc: 0.6986 - val_loss: 0.6862 - val_acc: 0.7000
Epoch 922/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7036 - acc: 0.6986 - val_loss: 0.6854 - val_acc: 0.7000
Epoch 923/3000
720/720 [==============================] - 0s 21us/step - loss: 0.7089 - acc: 0.7014 - val_loss: 0.6842 - val_acc: 0.7000
Epoch 924/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7117 - acc: 0.6944 - val_loss: 0.6833 - val_acc: 0.7000
Epoch 925/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7153 - acc: 0.6861 - val_loss: 0.6827 - val_acc: 0.7000
Epoch 926/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7141 - acc: 0.6944 - val_loss: 0.6824 - val_acc: 0.7000
Epoch 927/3000
720/720 [==============================] - 0s 32us/step - loss: 0.7332 - acc: 0.6917 - val_loss: 0.6826 - val_acc: 0.7056
Epoch 928/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6920 - acc: 0.6944 - val_loss: 0.6830 - val_acc: 0.7056
Epoch 929/3000
720/720 [==============================] - 0s 37us/step - loss: 0.7019 - acc: 0.7111 - val_loss: 0.6835 - val_acc: 0.7056
Epoch 930/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7116 - acc: 0.6889 - val_loss: 0.6842 - val_acc: 0.7056
Epoch 931/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7389 - acc: 0.6819 - val_loss: 0.6845 - val_acc: 0.7056
Epoch 932/3000
720/720 [==============================] - 0s 33us/step - loss: 0.7131 - acc: 0.6931 - val_loss: 0.6844 - val_acc: 0.7111
Epoch 933/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7137 - acc: 0.7056 - val_loss: 0.6839 - val_acc: 0.7111
Epoch 934/3000
720/720 [==============================] - 0s 40us/step - loss: 0.7067 - acc: 0.6958 - val_loss: 0.6835 - val_acc: 0.7111
Epoch 935/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7319 - acc: 0.6986 - val_loss: 0.6829 - val_acc: 0.7111
Epoch 936/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7102 - acc: 0.6944 - val_loss: 0.6822 - val_acc: 0.7111
Epoch 937/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7048 - acc: 0.7028 - val_loss: 0.6819 - val_acc: 0.7111
Epoch 938/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7105 - acc: 0.6986 - val_loss: 0.6814 - val_acc: 0.7111
Epoch 939/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7276 - acc: 0.6944 - val_loss: 0.6810 - val_acc: 0.7111
Epoch 940/3000
720/720 [==============================] - 0s 36us/step - loss: 0.6991 - acc: 0.7125 - val_loss: 0.6804 - val_acc: 0.7111
Epoch 941/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7188 - acc: 0.6903 - val_loss: 0.6792 - val_acc: 0.7111
Epoch 942/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7375 - acc: 0.6792 - val_loss: 0.6783 - val_acc: 0.7111
Epoch 943/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7255 - acc: 0.6917 - val_loss: 0.6772 - val_acc: 0.7111
Epoch 944/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7075 - acc: 0.6931 - val_loss: 0.6763 - val_acc: 0.7056
Epoch 945/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7192 - acc: 0.6847 - val_loss: 0.6756 - val_acc: 0.7000
Epoch 946/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7032 - acc: 0.6931 - val_loss: 0.6741 - val_acc: 0.7000
Epoch 947/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7179 - acc: 0.6875 - val_loss: 0.6725 - val_acc: 0.7000
Epoch 948/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7100 - acc: 0.7000 - val_loss: 0.6717 - val_acc: 0.7000
Epoch 949/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7310 - acc: 0.6931 - val_loss: 0.6715 - val_acc: 0.7000
Epoch 950/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7168 - acc: 0.6861 - val_loss: 0.6718 - val_acc: 0.7000
Epoch 951/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7317 - acc: 0.6903 - val_loss: 0.6721 - val_acc: 0.7000
Epoch 952/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7394 - acc: 0.6847 - val_loss: 0.6725 - val_acc: 0.7000
Epoch 953/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7214 - acc: 0.6889 - val_loss: 0.6733 - val_acc: 0.7000
Epoch 954/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7221 - acc: 0.6903 - val_loss: 0.6742 - val_acc: 0.6944
Epoch 955/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7124 - acc: 0.6903 - val_loss: 0.6750 - val_acc: 0.6889
Epoch 956/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6983 - acc: 0.7028 - val_loss: 0.6755 - val_acc: 0.6944
Epoch 957/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7397 - acc: 0.6931 - val_loss: 0.6757 - val_acc: 0.6944
Epoch 958/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7444 - acc: 0.6861 - val_loss: 0.6760 - val_acc: 0.6944
Epoch 959/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7391 - acc: 0.6722 - val_loss: 0.6760 - val_acc: 0.7000
Epoch 960/3000
720/720 [==============================] - 0s 43us/step - loss: 0.7221 - acc: 0.6875 - val_loss: 0.6758 - val_acc: 0.7000
Epoch 961/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7171 - acc: 0.6972 - val_loss: 0.6762 - val_acc: 0.7056
Epoch 962/3000
720/720 [==============================] - 0s 21us/step - loss: 0.7166 - acc: 0.6944 - val_loss: 0.6769 - val_acc: 0.7056
Epoch 963/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7168 - acc: 0.7028 - val_loss: 0.6775 - val_acc: 0.7000
Epoch 964/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7143 - acc: 0.6931 - val_loss: 0.6780 - val_acc: 0.7000
Epoch 965/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7131 - acc: 0.6986 - val_loss: 0.6785 - val_acc: 0.7000
Epoch 966/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7264 - acc: 0.6944 - val_loss: 0.6786 - val_acc: 0.7000
Epoch 967/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7173 - acc: 0.7028 - val_loss: 0.6788 - val_acc: 0.6944
Epoch 968/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7109 - acc: 0.7042 - val_loss: 0.6788 - val_acc: 0.6944
Epoch 969/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7255 - acc: 0.7000 - val_loss: 0.6790 - val_acc: 0.6944
Epoch 970/3000
720/720 [==============================] - 0s 32us/step - loss: 0.7194 - acc: 0.7111 - val_loss: 0.6792 - val_acc: 0.6944
Epoch 971/3000
720/720 [==============================] - 0s 39us/step - loss: 0.7162 - acc: 0.6861 - val_loss: 0.6792 - val_acc: 0.6944
Epoch 972/3000
720/720 [==============================] - 0s 46us/step - loss: 0.7270 - acc: 0.7028 - val_loss: 0.6789 - val_acc: 0.7000
Epoch 973/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7045 - acc: 0.7000 - val_loss: 0.6782 - val_acc: 0.7000
Epoch 974/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7090 - acc: 0.6958 - val_loss: 0.6774 - val_acc: 0.7056
Epoch 975/3000
720/720 [==============================] - 0s 38us/step - loss: 0.7025 - acc: 0.6972 - val_loss: 0.6768 - val_acc: 0.7056
Epoch 976/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7067 - acc: 0.7028 - val_loss: 0.6767 - val_acc: 0.7056
Epoch 977/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7161 - acc: 0.6917 - val_loss: 0.6770 - val_acc: 0.7056
Epoch 978/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7054 - acc: 0.7028 - val_loss: 0.6772 - val_acc: 0.7056
Epoch 979/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7212 - acc: 0.6778 - val_loss: 0.6775 - val_acc: 0.7056
Epoch 980/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7386 - acc: 0.6819 - val_loss: 0.6782 - val_acc: 0.7056
Epoch 981/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7217 - acc: 0.6819 - val_loss: 0.6785 - val_acc: 0.7056
Epoch 982/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7217 - acc: 0.6875 - val_loss: 0.6790 - val_acc: 0.7056
Epoch 983/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7294 - acc: 0.6889 - val_loss: 0.6796 - val_acc: 0.7056
Epoch 984/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7167 - acc: 0.6986 - val_loss: 0.6801 - val_acc: 0.6944
Epoch 985/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7135 - acc: 0.7069 - val_loss: 0.6804 - val_acc: 0.6944
Epoch 986/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7037 - acc: 0.6833 - val_loss: 0.6812 - val_acc: 0.7000
Epoch 987/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7134 - acc: 0.6972 - val_loss: 0.6818 - val_acc: 0.7000
Epoch 988/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7155 - acc: 0.6847 - val_loss: 0.6831 - val_acc: 0.7000
Epoch 989/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7138 - acc: 0.6958 - val_loss: 0.6847 - val_acc: 0.7056
Epoch 990/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7043 - acc: 0.6931 - val_loss: 0.6855 - val_acc: 0.7000
Epoch 991/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6947 - acc: 0.7056 - val_loss: 0.6863 - val_acc: 0.7000
Epoch 992/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7199 - acc: 0.7056 - val_loss: 0.6865 - val_acc: 0.7000
Epoch 993/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7189 - acc: 0.6986 - val_loss: 0.6856 - val_acc: 0.7000
Epoch 994/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6939 - acc: 0.7014 - val_loss: 0.6851 - val_acc: 0.7000
Epoch 995/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7293 - acc: 0.6944 - val_loss: 0.6845 - val_acc: 0.6944
Epoch 996/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7336 - acc: 0.6903 - val_loss: 0.6830 - val_acc: 0.7000
Epoch 997/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6961 - acc: 0.6972 - val_loss: 0.6824 - val_acc: 0.7000
Epoch 998/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7315 - acc: 0.6861 - val_loss: 0.6822 - val_acc: 0.6944
Epoch 999/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7202 - acc: 0.6903 - val_loss: 0.6813 - val_acc: 0.6944
Epoch 1000/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7309 - acc: 0.6889 - val_loss: 0.6801 - val_acc: 0.7000
Epoch 1001/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7093 - acc: 0.7028 - val_loss: 0.6794 - val_acc: 0.7000
Epoch 1002/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7095 - acc: 0.6889 - val_loss: 0.6792 - val_acc: 0.7000
Epoch 1003/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7324 - acc: 0.6889 - val_loss: 0.6794 - val_acc: 0.6944
Epoch 1004/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7087 - acc: 0.7014 - val_loss: 0.6799 - val_acc: 0.6944
Epoch 1005/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7362 - acc: 0.6889 - val_loss: 0.6798 - val_acc: 0.6944
Epoch 1006/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7102 - acc: 0.7028 - val_loss: 0.6802 - val_acc: 0.6889
Epoch 1007/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7053 - acc: 0.6903 - val_loss: 0.6806 - val_acc: 0.6889
Epoch 1008/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7265 - acc: 0.6792 - val_loss: 0.6792 - val_acc: 0.6944
Epoch 1009/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7110 - acc: 0.7000 - val_loss: 0.6779 - val_acc: 0.7000
Epoch 1010/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7168 - acc: 0.7000 - val_loss: 0.6769 - val_acc: 0.7000
Epoch 1011/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7273 - acc: 0.7014 - val_loss: 0.6760 - val_acc: 0.7000
Epoch 1012/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7218 - acc: 0.6958 - val_loss: 0.6757 - val_acc: 0.7111
Epoch 1013/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6947 - acc: 0.7111 - val_loss: 0.6753 - val_acc: 0.7111
Epoch 1014/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7134 - acc: 0.6806 - val_loss: 0.6756 - val_acc: 0.7111
Epoch 1015/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7332 - acc: 0.6917 - val_loss: 0.6760 - val_acc: 0.7056
Epoch 1016/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7101 - acc: 0.6889 - val_loss: 0.6760 - val_acc: 0.7056
Epoch 1017/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7263 - acc: 0.6931 - val_loss: 0.6757 - val_acc: 0.6944
Epoch 1018/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6988 - acc: 0.7111 - val_loss: 0.6747 - val_acc: 0.7056
Epoch 1019/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7183 - acc: 0.6944 - val_loss: 0.6741 - val_acc: 0.7056
Epoch 1020/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7174 - acc: 0.7042 - val_loss: 0.6736 - val_acc: 0.7111
Epoch 1021/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7271 - acc: 0.7028 - val_loss: 0.6734 - val_acc: 0.7111
Epoch 1022/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7076 - acc: 0.6931 - val_loss: 0.6728 - val_acc: 0.7111
Epoch 1023/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7250 - acc: 0.6847 - val_loss: 0.6723 - val_acc: 0.7111
Epoch 1024/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7180 - acc: 0.6889 - val_loss: 0.6721 - val_acc: 0.7111
Epoch 1025/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7148 - acc: 0.6903 - val_loss: 0.6725 - val_acc: 0.7111
Epoch 1026/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7151 - acc: 0.7097 - val_loss: 0.6730 - val_acc: 0.7111
Epoch 1027/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7189 - acc: 0.6861 - val_loss: 0.6735 - val_acc: 0.7111
Epoch 1028/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7146 - acc: 0.7042 - val_loss: 0.6743 - val_acc: 0.7056
Epoch 1029/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7203 - acc: 0.7083 - val_loss: 0.6746 - val_acc: 0.7111
Epoch 1030/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7335 - acc: 0.6931 - val_loss: 0.6752 - val_acc: 0.7111
Epoch 1031/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7078 - acc: 0.6958 - val_loss: 0.6764 - val_acc: 0.7056
Epoch 1032/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6935 - acc: 0.7069 - val_loss: 0.6776 - val_acc: 0.7000
Epoch 1033/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7114 - acc: 0.6903 - val_loss: 0.6780 - val_acc: 0.7056
Epoch 1034/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7008 - acc: 0.7056 - val_loss: 0.6783 - val_acc: 0.7056
Epoch 1035/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7078 - acc: 0.7153 - val_loss: 0.6785 - val_acc: 0.7167
Epoch 1036/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7226 - acc: 0.6875 - val_loss: 0.6787 - val_acc: 0.7056
Epoch 1037/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7353 - acc: 0.6986 - val_loss: 0.6779 - val_acc: 0.7111
Epoch 1038/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7124 - acc: 0.6903 - val_loss: 0.6770 - val_acc: 0.7056
Epoch 1039/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7073 - acc: 0.7042 - val_loss: 0.6759 - val_acc: 0.7056
Epoch 1040/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7399 - acc: 0.6903 - val_loss: 0.6751 - val_acc: 0.7056
Epoch 1041/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7103 - acc: 0.6847 - val_loss: 0.6745 - val_acc: 0.7056
Epoch 1042/3000
720/720 [==============================] - 0s 11us/step - loss: 0.7093 - acc: 0.6889 - val_loss: 0.6745 - val_acc: 0.7111
Epoch 1043/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7122 - acc: 0.6931 - val_loss: 0.6748 - val_acc: 0.7056
Epoch 1044/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6994 - acc: 0.7056 - val_loss: 0.6753 - val_acc: 0.7111
Epoch 1045/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6923 - acc: 0.7069 - val_loss: 0.6753 - val_acc: 0.7167
Epoch 1046/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7299 - acc: 0.6972 - val_loss: 0.6748 - val_acc: 0.7111
Epoch 1047/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7051 - acc: 0.7069 - val_loss: 0.6745 - val_acc: 0.7167
Epoch 1048/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7245 - acc: 0.6889 - val_loss: 0.6745 - val_acc: 0.7056
Epoch 1049/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7159 - acc: 0.6792 - val_loss: 0.6750 - val_acc: 0.7056
Epoch 1050/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7173 - acc: 0.6944 - val_loss: 0.6751 - val_acc: 0.7056
Epoch 1051/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7105 - acc: 0.6806 - val_loss: 0.6756 - val_acc: 0.7056
Epoch 1052/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7220 - acc: 0.6861 - val_loss: 0.6756 - val_acc: 0.7056
Epoch 1053/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7071 - acc: 0.6931 - val_loss: 0.6761 - val_acc: 0.7056
Epoch 1054/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7248 - acc: 0.6889 - val_loss: 0.6766 - val_acc: 0.7000
Epoch 1055/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7153 - acc: 0.7000 - val_loss: 0.6777 - val_acc: 0.6944
Epoch 1056/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6838 - acc: 0.7042 - val_loss: 0.6795 - val_acc: 0.6889
Epoch 1057/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7066 - acc: 0.6972 - val_loss: 0.6820 - val_acc: 0.6944
Epoch 1058/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7270 - acc: 0.6889 - val_loss: 0.6845 - val_acc: 0.6889
Epoch 1059/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7013 - acc: 0.6944 - val_loss: 0.6884 - val_acc: 0.6833
Epoch 1060/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7149 - acc: 0.6889 - val_loss: 0.6922 - val_acc: 0.6889
Epoch 1061/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7156 - acc: 0.6986 - val_loss: 0.6960 - val_acc: 0.6889
Epoch 1062/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7219 - acc: 0.6958 - val_loss: 0.7002 - val_acc: 0.6889
Epoch 1063/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7131 - acc: 0.7000 - val_loss: 0.7024 - val_acc: 0.6833
Epoch 1064/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7049 - acc: 0.6972 - val_loss: 0.7054 - val_acc: 0.6833
Epoch 1065/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7160 - acc: 0.6958 - val_loss: 0.7076 - val_acc: 0.6889
Epoch 1066/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7122 - acc: 0.6931 - val_loss: 0.7085 - val_acc: 0.6833
Epoch 1067/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7279 - acc: 0.6889 - val_loss: 0.7070 - val_acc: 0.6833
Epoch 1068/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7311 - acc: 0.6917 - val_loss: 0.7064 - val_acc: 0.6889
Epoch 1069/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7208 - acc: 0.6861 - val_loss: 0.7046 - val_acc: 0.6889
Epoch 1070/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6931 - acc: 0.7000 - val_loss: 0.7031 - val_acc: 0.6889
Epoch 1071/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7205 - acc: 0.6917 - val_loss: 0.7013 - val_acc: 0.6944
Epoch 1072/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6886 - acc: 0.7014 - val_loss: 0.7001 - val_acc: 0.7000
Epoch 1073/3000
720/720 [==============================] - 0s 19us/step - loss: 0.7154 - acc: 0.6861 - val_loss: 0.6971 - val_acc: 0.6889
Epoch 1074/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6996 - acc: 0.6889 - val_loss: 0.6956 - val_acc: 0.6889
Epoch 1075/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7109 - acc: 0.6958 - val_loss: 0.6947 - val_acc: 0.6889
Epoch 1076/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7056 - acc: 0.6778 - val_loss: 0.6942 - val_acc: 0.6944
Epoch 1077/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6998 - acc: 0.7097 - val_loss: 0.6936 - val_acc: 0.6944
Epoch 1078/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7158 - acc: 0.6889 - val_loss: 0.6932 - val_acc: 0.6944
Epoch 1079/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7351 - acc: 0.6819 - val_loss: 0.6932 - val_acc: 0.6944
Epoch 1080/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6884 - acc: 0.7208 - val_loss: 0.6929 - val_acc: 0.6944
Epoch 1081/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7099 - acc: 0.6889 - val_loss: 0.6924 - val_acc: 0.7000
Epoch 1082/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7003 - acc: 0.6931 - val_loss: 0.6923 - val_acc: 0.6944
Epoch 1083/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7172 - acc: 0.6972 - val_loss: 0.6929 - val_acc: 0.6889
Epoch 1084/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7103 - acc: 0.6889 - val_loss: 0.6934 - val_acc: 0.6944
Epoch 1085/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6918 - acc: 0.7111 - val_loss: 0.6945 - val_acc: 0.6944
Epoch 1086/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7226 - acc: 0.6931 - val_loss: 0.6953 - val_acc: 0.6944
Epoch 1087/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7172 - acc: 0.6875 - val_loss: 0.6959 - val_acc: 0.7000
Epoch 1088/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7220 - acc: 0.7028 - val_loss: 0.6946 - val_acc: 0.7056
Epoch 1089/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7153 - acc: 0.6931 - val_loss: 0.6929 - val_acc: 0.7056
Epoch 1090/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7143 - acc: 0.6833 - val_loss: 0.6914 - val_acc: 0.7167
Epoch 1091/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7296 - acc: 0.7153 - val_loss: 0.6905 - val_acc: 0.7111
Epoch 1092/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7232 - acc: 0.6861 - val_loss: 0.6905 - val_acc: 0.7111
Epoch 1093/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7143 - acc: 0.6986 - val_loss: 0.6911 - val_acc: 0.7111
Epoch 1094/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7023 - acc: 0.6917 - val_loss: 0.6922 - val_acc: 0.7056
Epoch 1095/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7041 - acc: 0.7042 - val_loss: 0.6940 - val_acc: 0.7056
Epoch 1096/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7119 - acc: 0.6889 - val_loss: 0.6958 - val_acc: 0.7000
Epoch 1097/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7136 - acc: 0.6958 - val_loss: 0.6980 - val_acc: 0.6944
Epoch 1098/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6862 - acc: 0.6931 - val_loss: 0.6990 - val_acc: 0.6944
Epoch 1099/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7245 - acc: 0.6944 - val_loss: 0.6990 - val_acc: 0.7000
Epoch 1100/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7097 - acc: 0.6875 - val_loss: 0.6995 - val_acc: 0.6944
Epoch 1101/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7129 - acc: 0.6903 - val_loss: 0.7003 - val_acc: 0.6889
Epoch 1102/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7106 - acc: 0.6972 - val_loss: 0.7001 - val_acc: 0.6889
Epoch 1103/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7169 - acc: 0.7028 - val_loss: 0.6991 - val_acc: 0.6944
Epoch 1104/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6901 - acc: 0.7000 - val_loss: 0.6989 - val_acc: 0.6889
Epoch 1105/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7073 - acc: 0.6972 - val_loss: 0.6987 - val_acc: 0.6944
Epoch 1106/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6987 - acc: 0.6931 - val_loss: 0.6965 - val_acc: 0.7000
Epoch 1107/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7294 - acc: 0.6903 - val_loss: 0.6933 - val_acc: 0.7111
Epoch 1108/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7026 - acc: 0.7236 - val_loss: 0.6901 - val_acc: 0.7000
Epoch 1109/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7184 - acc: 0.6903 - val_loss: 0.6873 - val_acc: 0.7000
Epoch 1110/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7092 - acc: 0.7069 - val_loss: 0.6833 - val_acc: 0.7056
Epoch 1111/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7028 - acc: 0.6972 - val_loss: 0.6800 - val_acc: 0.7167
Epoch 1112/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7136 - acc: 0.6819 - val_loss: 0.6771 - val_acc: 0.7167
Epoch 1113/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7093 - acc: 0.6889 - val_loss: 0.6752 - val_acc: 0.7167
Epoch 1114/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7053 - acc: 0.7056 - val_loss: 0.6740 - val_acc: 0.7167
Epoch 1115/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7033 - acc: 0.7056 - val_loss: 0.6726 - val_acc: 0.7167
Epoch 1116/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7179 - acc: 0.7000 - val_loss: 0.6715 - val_acc: 0.7111
Epoch 1117/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6905 - acc: 0.7194 - val_loss: 0.6712 - val_acc: 0.7111
Epoch 1118/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7098 - acc: 0.6931 - val_loss: 0.6711 - val_acc: 0.7111
Epoch 1119/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7026 - acc: 0.7153 - val_loss: 0.6711 - val_acc: 0.7111
Epoch 1120/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7188 - acc: 0.6917 - val_loss: 0.6716 - val_acc: 0.7111
Epoch 1121/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7221 - acc: 0.6806 - val_loss: 0.6721 - val_acc: 0.7111
Epoch 1122/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7219 - acc: 0.6875 - val_loss: 0.6727 - val_acc: 0.7167
Epoch 1123/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7112 - acc: 0.6806 - val_loss: 0.6732 - val_acc: 0.7111
Epoch 1124/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7081 - acc: 0.6986 - val_loss: 0.6738 - val_acc: 0.7056
Epoch 1125/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7218 - acc: 0.6944 - val_loss: 0.6742 - val_acc: 0.7111
Epoch 1126/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6911 - acc: 0.7153 - val_loss: 0.6747 - val_acc: 0.7111
Epoch 1127/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6943 - acc: 0.6986 - val_loss: 0.6750 - val_acc: 0.7111
Epoch 1128/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7184 - acc: 0.6889 - val_loss: 0.6754 - val_acc: 0.7111
Epoch 1129/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6918 - acc: 0.6972 - val_loss: 0.6765 - val_acc: 0.7000
Epoch 1130/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6966 - acc: 0.6944 - val_loss: 0.6786 - val_acc: 0.7056
Epoch 1131/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7150 - acc: 0.7042 - val_loss: 0.6811 - val_acc: 0.7000
Epoch 1132/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7110 - acc: 0.7056 - val_loss: 0.6844 - val_acc: 0.7056
Epoch 1133/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7128 - acc: 0.6972 - val_loss: 0.6881 - val_acc: 0.7056
Epoch 1134/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7067 - acc: 0.7069 - val_loss: 0.6914 - val_acc: 0.6889
Epoch 1135/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7181 - acc: 0.6958 - val_loss: 0.6942 - val_acc: 0.6889
Epoch 1136/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7218 - acc: 0.6875 - val_loss: 0.6952 - val_acc: 0.6889
Epoch 1137/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7256 - acc: 0.6917 - val_loss: 0.6946 - val_acc: 0.6889
Epoch 1138/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7249 - acc: 0.6833 - val_loss: 0.6927 - val_acc: 0.7000
Epoch 1139/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7169 - acc: 0.6889 - val_loss: 0.6907 - val_acc: 0.7000
Epoch 1140/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7133 - acc: 0.6986 - val_loss: 0.6884 - val_acc: 0.7111
Epoch 1141/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7064 - acc: 0.7028 - val_loss: 0.6863 - val_acc: 0.7111
Epoch 1142/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6911 - acc: 0.7042 - val_loss: 0.6835 - val_acc: 0.7111
Epoch 1143/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7056 - acc: 0.7083 - val_loss: 0.6810 - val_acc: 0.7167
Epoch 1144/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6908 - acc: 0.7167 - val_loss: 0.6791 - val_acc: 0.7167
Epoch 1145/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7274 - acc: 0.6917 - val_loss: 0.6775 - val_acc: 0.7111
Epoch 1146/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7126 - acc: 0.6958 - val_loss: 0.6762 - val_acc: 0.7111
Epoch 1147/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7088 - acc: 0.6903 - val_loss: 0.6756 - val_acc: 0.7167
Epoch 1148/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6984 - acc: 0.7028 - val_loss: 0.6752 - val_acc: 0.7111
Epoch 1149/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7057 - acc: 0.6903 - val_loss: 0.6759 - val_acc: 0.7056
Epoch 1150/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6993 - acc: 0.6972 - val_loss: 0.6758 - val_acc: 0.7111
Epoch 1151/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7056 - acc: 0.6889 - val_loss: 0.6763 - val_acc: 0.7111
Epoch 1152/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6857 - acc: 0.7000 - val_loss: 0.6766 - val_acc: 0.7111
Epoch 1153/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6930 - acc: 0.7056 - val_loss: 0.6774 - val_acc: 0.7111
Epoch 1154/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7008 - acc: 0.7028 - val_loss: 0.6794 - val_acc: 0.7056
Epoch 1155/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7115 - acc: 0.6917 - val_loss: 0.6810 - val_acc: 0.7111
Epoch 1156/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6981 - acc: 0.7000 - val_loss: 0.6832 - val_acc: 0.7056
Epoch 1157/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7073 - acc: 0.6958 - val_loss: 0.6861 - val_acc: 0.7056
Epoch 1158/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7052 - acc: 0.7028 - val_loss: 0.6889 - val_acc: 0.6944
Epoch 1159/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7122 - acc: 0.6944 - val_loss: 0.6912 - val_acc: 0.6944
Epoch 1160/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7281 - acc: 0.6792 - val_loss: 0.6927 - val_acc: 0.7000
Epoch 1161/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6900 - acc: 0.7056 - val_loss: 0.6934 - val_acc: 0.7000
Epoch 1162/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7142 - acc: 0.6931 - val_loss: 0.6931 - val_acc: 0.7000
Epoch 1163/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7060 - acc: 0.7125 - val_loss: 0.6918 - val_acc: 0.7056
Epoch 1164/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7117 - acc: 0.6819 - val_loss: 0.6896 - val_acc: 0.7111
Epoch 1165/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7057 - acc: 0.7069 - val_loss: 0.6874 - val_acc: 0.7167
Epoch 1166/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7225 - acc: 0.6861 - val_loss: 0.6856 - val_acc: 0.7056
Epoch 1167/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6935 - acc: 0.7153 - val_loss: 0.6834 - val_acc: 0.7056
Epoch 1168/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7044 - acc: 0.7069 - val_loss: 0.6801 - val_acc: 0.7111
Epoch 1169/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7065 - acc: 0.6861 - val_loss: 0.6774 - val_acc: 0.7056
Epoch 1170/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7072 - acc: 0.6958 - val_loss: 0.6747 - val_acc: 0.7111
Epoch 1171/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7176 - acc: 0.6931 - val_loss: 0.6724 - val_acc: 0.7167
Epoch 1172/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7217 - acc: 0.6861 - val_loss: 0.6710 - val_acc: 0.7222
Epoch 1173/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7087 - acc: 0.6972 - val_loss: 0.6705 - val_acc: 0.7222
Epoch 1174/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6963 - acc: 0.7083 - val_loss: 0.6708 - val_acc: 0.7222
Epoch 1175/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7116 - acc: 0.7014 - val_loss: 0.6712 - val_acc: 0.7167
Epoch 1176/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7268 - acc: 0.6958 - val_loss: 0.6719 - val_acc: 0.7167
Epoch 1177/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6931 - acc: 0.7069 - val_loss: 0.6727 - val_acc: 0.7167
Epoch 1178/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6794 - acc: 0.7097 - val_loss: 0.6733 - val_acc: 0.7167
Epoch 1179/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7079 - acc: 0.6958 - val_loss: 0.6737 - val_acc: 0.7167
Epoch 1180/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7028 - acc: 0.6972 - val_loss: 0.6743 - val_acc: 0.7167
Epoch 1181/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7079 - acc: 0.7028 - val_loss: 0.6745 - val_acc: 0.7167
Epoch 1182/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6913 - acc: 0.7028 - val_loss: 0.6747 - val_acc: 0.7167
Epoch 1183/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7195 - acc: 0.7125 - val_loss: 0.6748 - val_acc: 0.7167
Epoch 1184/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7020 - acc: 0.7069 - val_loss: 0.6746 - val_acc: 0.7167
Epoch 1185/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7132 - acc: 0.6889 - val_loss: 0.6742 - val_acc: 0.7167
Epoch 1186/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7115 - acc: 0.6944 - val_loss: 0.6740 - val_acc: 0.7167
Epoch 1187/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7214 - acc: 0.6986 - val_loss: 0.6738 - val_acc: 0.7167
Epoch 1188/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6663 - acc: 0.7181 - val_loss: 0.6737 - val_acc: 0.7222
Epoch 1189/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7148 - acc: 0.6944 - val_loss: 0.6737 - val_acc: 0.7167
Epoch 1190/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6746 - acc: 0.7056 - val_loss: 0.6737 - val_acc: 0.7222
Epoch 1191/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7197 - acc: 0.7056 - val_loss: 0.6735 - val_acc: 0.7222
Epoch 1192/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7087 - acc: 0.6972 - val_loss: 0.6737 - val_acc: 0.7333
Epoch 1193/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6998 - acc: 0.6972 - val_loss: 0.6733 - val_acc: 0.7333
Epoch 1194/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7098 - acc: 0.7153 - val_loss: 0.6726 - val_acc: 0.7333
Epoch 1195/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7075 - acc: 0.6986 - val_loss: 0.6721 - val_acc: 0.7333
Epoch 1196/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7063 - acc: 0.6958 - val_loss: 0.6717 - val_acc: 0.7333
Epoch 1197/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7265 - acc: 0.6875 - val_loss: 0.6710 - val_acc: 0.7333
Epoch 1198/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7005 - acc: 0.6903 - val_loss: 0.6703 - val_acc: 0.7333
Epoch 1199/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7194 - acc: 0.6972 - val_loss: 0.6696 - val_acc: 0.7333
Epoch 1200/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7119 - acc: 0.6986 - val_loss: 0.6689 - val_acc: 0.7278
Epoch 1201/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7048 - acc: 0.6875 - val_loss: 0.6679 - val_acc: 0.7222
Epoch 1202/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7174 - acc: 0.6917 - val_loss: 0.6673 - val_acc: 0.7111
Epoch 1203/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6853 - acc: 0.7000 - val_loss: 0.6667 - val_acc: 0.7111
Epoch 1204/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7132 - acc: 0.7042 - val_loss: 0.6661 - val_acc: 0.7111
Epoch 1205/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6982 - acc: 0.7056 - val_loss: 0.6649 - val_acc: 0.7111
Epoch 1206/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6852 - acc: 0.6903 - val_loss: 0.6644 - val_acc: 0.7111
Epoch 1207/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7043 - acc: 0.6972 - val_loss: 0.6637 - val_acc: 0.7111
Epoch 1208/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7045 - acc: 0.7000 - val_loss: 0.6624 - val_acc: 0.7111
Epoch 1209/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7128 - acc: 0.7056 - val_loss: 0.6617 - val_acc: 0.7056
Epoch 1210/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6950 - acc: 0.7028 - val_loss: 0.6610 - val_acc: 0.7111
Epoch 1211/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7058 - acc: 0.7028 - val_loss: 0.6603 - val_acc: 0.7111
Epoch 1212/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7104 - acc: 0.7097 - val_loss: 0.6599 - val_acc: 0.7111
Epoch 1213/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6934 - acc: 0.6958 - val_loss: 0.6597 - val_acc: 0.7111
Epoch 1214/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6805 - acc: 0.7153 - val_loss: 0.6596 - val_acc: 0.7167
Epoch 1215/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7006 - acc: 0.7139 - val_loss: 0.6596 - val_acc: 0.7111
Epoch 1216/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7014 - acc: 0.7028 - val_loss: 0.6596 - val_acc: 0.7111
Epoch 1217/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7042 - acc: 0.6958 - val_loss: 0.6598 - val_acc: 0.7111
Epoch 1218/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6759 - acc: 0.7028 - val_loss: 0.6603 - val_acc: 0.7111
Epoch 1219/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7200 - acc: 0.6931 - val_loss: 0.6605 - val_acc: 0.7111
Epoch 1220/3000
720/720 [==============================] - 0s 25us/step - loss: 0.7011 - acc: 0.6833 - val_loss: 0.6608 - val_acc: 0.7111
Epoch 1221/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6926 - acc: 0.7069 - val_loss: 0.6609 - val_acc: 0.7111
Epoch 1222/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6923 - acc: 0.7028 - val_loss: 0.6611 - val_acc: 0.7111
Epoch 1223/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7298 - acc: 0.6764 - val_loss: 0.6616 - val_acc: 0.7167
Epoch 1224/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7061 - acc: 0.7153 - val_loss: 0.6617 - val_acc: 0.7167
Epoch 1225/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7129 - acc: 0.7000 - val_loss: 0.6613 - val_acc: 0.7167
Epoch 1226/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7065 - acc: 0.6903 - val_loss: 0.6613 - val_acc: 0.7167
Epoch 1227/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7154 - acc: 0.6847 - val_loss: 0.6608 - val_acc: 0.7111
Epoch 1228/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6934 - acc: 0.7139 - val_loss: 0.6602 - val_acc: 0.7056
Epoch 1229/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7044 - acc: 0.7014 - val_loss: 0.6604 - val_acc: 0.7056
Epoch 1230/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6903 - acc: 0.7056 - val_loss: 0.6610 - val_acc: 0.7000
Epoch 1231/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6934 - acc: 0.7167 - val_loss: 0.6626 - val_acc: 0.6944
Epoch 1232/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7359 - acc: 0.6708 - val_loss: 0.6647 - val_acc: 0.7000
Epoch 1233/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6891 - acc: 0.7014 - val_loss: 0.6681 - val_acc: 0.6944
Epoch 1234/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6859 - acc: 0.6944 - val_loss: 0.6721 - val_acc: 0.7000
Epoch 1235/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6863 - acc: 0.7056 - val_loss: 0.6763 - val_acc: 0.7000
Epoch 1236/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7124 - acc: 0.6917 - val_loss: 0.6811 - val_acc: 0.7056
Epoch 1237/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7076 - acc: 0.7056 - val_loss: 0.6840 - val_acc: 0.7000
Epoch 1238/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7046 - acc: 0.7139 - val_loss: 0.6842 - val_acc: 0.7000
Epoch 1239/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7026 - acc: 0.6972 - val_loss: 0.6826 - val_acc: 0.6889
Epoch 1240/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6926 - acc: 0.7042 - val_loss: 0.6814 - val_acc: 0.7000
Epoch 1241/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7037 - acc: 0.7056 - val_loss: 0.6806 - val_acc: 0.6944
Epoch 1242/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6863 - acc: 0.7083 - val_loss: 0.6791 - val_acc: 0.7000
Epoch 1243/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6925 - acc: 0.6958 - val_loss: 0.6773 - val_acc: 0.7000
Epoch 1244/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6946 - acc: 0.7097 - val_loss: 0.6756 - val_acc: 0.7056
Epoch 1245/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7120 - acc: 0.7083 - val_loss: 0.6737 - val_acc: 0.7111
Epoch 1246/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7078 - acc: 0.6792 - val_loss: 0.6722 - val_acc: 0.7056
Epoch 1247/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7148 - acc: 0.7069 - val_loss: 0.6724 - val_acc: 0.7056
Epoch 1248/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6926 - acc: 0.7056 - val_loss: 0.6731 - val_acc: 0.7056
Epoch 1249/3000
720/720 [==============================] - 0s 18us/step - loss: 0.7020 - acc: 0.6986 - val_loss: 0.6727 - val_acc: 0.7111
Epoch 1250/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6969 - acc: 0.7194 - val_loss: 0.6724 - val_acc: 0.7111
Epoch 1251/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7209 - acc: 0.6903 - val_loss: 0.6726 - val_acc: 0.7111
Epoch 1252/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6993 - acc: 0.7042 - val_loss: 0.6729 - val_acc: 0.7111
Epoch 1253/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7070 - acc: 0.7042 - val_loss: 0.6730 - val_acc: 0.7167
Epoch 1254/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7066 - acc: 0.7056 - val_loss: 0.6738 - val_acc: 0.7111
Epoch 1255/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6807 - acc: 0.7125 - val_loss: 0.6746 - val_acc: 0.7111
Epoch 1256/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7008 - acc: 0.6986 - val_loss: 0.6747 - val_acc: 0.7111
Epoch 1257/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6905 - acc: 0.7125 - val_loss: 0.6744 - val_acc: 0.7111
Epoch 1258/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7079 - acc: 0.7028 - val_loss: 0.6736 - val_acc: 0.7111
Epoch 1259/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6909 - acc: 0.7069 - val_loss: 0.6733 - val_acc: 0.7111
Epoch 1260/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7091 - acc: 0.6958 - val_loss: 0.6722 - val_acc: 0.7111
Epoch 1261/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6952 - acc: 0.7069 - val_loss: 0.6718 - val_acc: 0.7111
Epoch 1262/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6919 - acc: 0.6931 - val_loss: 0.6714 - val_acc: 0.7111
Epoch 1263/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7087 - acc: 0.7042 - val_loss: 0.6715 - val_acc: 0.7056
Epoch 1264/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7040 - acc: 0.6875 - val_loss: 0.6712 - val_acc: 0.7111
Epoch 1265/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7132 - acc: 0.6806 - val_loss: 0.6707 - val_acc: 0.7111
Epoch 1266/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7056 - acc: 0.7042 - val_loss: 0.6702 - val_acc: 0.7111
Epoch 1267/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6998 - acc: 0.7125 - val_loss: 0.6695 - val_acc: 0.7111
Epoch 1268/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6983 - acc: 0.7097 - val_loss: 0.6694 - val_acc: 0.7111
Epoch 1269/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6733 - acc: 0.7111 - val_loss: 0.6688 - val_acc: 0.7111
Epoch 1270/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6753 - acc: 0.7028 - val_loss: 0.6683 - val_acc: 0.7111
Epoch 1271/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6950 - acc: 0.6958 - val_loss: 0.6680 - val_acc: 0.7111
Epoch 1272/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6921 - acc: 0.7042 - val_loss: 0.6668 - val_acc: 0.7167
Epoch 1273/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7118 - acc: 0.7056 - val_loss: 0.6659 - val_acc: 0.7167
Epoch 1274/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6937 - acc: 0.7028 - val_loss: 0.6649 - val_acc: 0.7167
Epoch 1275/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6830 - acc: 0.6931 - val_loss: 0.6641 - val_acc: 0.7222
Epoch 1276/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6969 - acc: 0.7139 - val_loss: 0.6631 - val_acc: 0.7222
Epoch 1277/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7115 - acc: 0.7014 - val_loss: 0.6611 - val_acc: 0.7167
Epoch 1278/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7136 - acc: 0.7014 - val_loss: 0.6587 - val_acc: 0.7222
Epoch 1279/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7030 - acc: 0.7028 - val_loss: 0.6574 - val_acc: 0.7167
Epoch 1280/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7150 - acc: 0.6819 - val_loss: 0.6563 - val_acc: 0.7167
Epoch 1281/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6979 - acc: 0.7139 - val_loss: 0.6559 - val_acc: 0.7167
Epoch 1282/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6948 - acc: 0.7056 - val_loss: 0.6557 - val_acc: 0.7222
Epoch 1283/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6745 - acc: 0.7153 - val_loss: 0.6561 - val_acc: 0.7222
Epoch 1284/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7015 - acc: 0.7167 - val_loss: 0.6563 - val_acc: 0.7222
Epoch 1285/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7140 - acc: 0.6958 - val_loss: 0.6567 - val_acc: 0.7222
Epoch 1286/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7006 - acc: 0.7000 - val_loss: 0.6573 - val_acc: 0.7111
Epoch 1287/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6965 - acc: 0.7000 - val_loss: 0.6578 - val_acc: 0.7111
Epoch 1288/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7021 - acc: 0.6861 - val_loss: 0.6582 - val_acc: 0.7111
Epoch 1289/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7092 - acc: 0.6931 - val_loss: 0.6585 - val_acc: 0.7111
Epoch 1290/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7087 - acc: 0.6847 - val_loss: 0.6590 - val_acc: 0.7111
Epoch 1291/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6810 - acc: 0.7014 - val_loss: 0.6599 - val_acc: 0.7056
Epoch 1292/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6901 - acc: 0.7153 - val_loss: 0.6615 - val_acc: 0.7056
Epoch 1293/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6747 - acc: 0.7181 - val_loss: 0.6635 - val_acc: 0.7056
Epoch 1294/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6632 - acc: 0.7236 - val_loss: 0.6654 - val_acc: 0.7000
Epoch 1295/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6954 - acc: 0.7028 - val_loss: 0.6667 - val_acc: 0.7000
Epoch 1296/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6898 - acc: 0.7181 - val_loss: 0.6677 - val_acc: 0.7000
Epoch 1297/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7104 - acc: 0.7000 - val_loss: 0.6692 - val_acc: 0.7000
Epoch 1298/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6831 - acc: 0.7083 - val_loss: 0.6710 - val_acc: 0.7056
Epoch 1299/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7239 - acc: 0.7014 - val_loss: 0.6723 - val_acc: 0.7000
Epoch 1300/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6963 - acc: 0.6931 - val_loss: 0.6746 - val_acc: 0.7000
Epoch 1301/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7164 - acc: 0.6736 - val_loss: 0.6747 - val_acc: 0.7000
Epoch 1302/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6877 - acc: 0.6986 - val_loss: 0.6737 - val_acc: 0.6944
Epoch 1303/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6754 - acc: 0.7069 - val_loss: 0.6714 - val_acc: 0.6944
Epoch 1304/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7074 - acc: 0.7042 - val_loss: 0.6685 - val_acc: 0.6944
Epoch 1305/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6943 - acc: 0.7097 - val_loss: 0.6657 - val_acc: 0.7056
Epoch 1306/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6973 - acc: 0.6944 - val_loss: 0.6643 - val_acc: 0.7000
Epoch 1307/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6926 - acc: 0.6833 - val_loss: 0.6634 - val_acc: 0.7056
Epoch 1308/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7040 - acc: 0.6931 - val_loss: 0.6635 - val_acc: 0.7056
Epoch 1309/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6975 - acc: 0.7069 - val_loss: 0.6631 - val_acc: 0.7056
Epoch 1310/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6997 - acc: 0.7097 - val_loss: 0.6622 - val_acc: 0.7056
Epoch 1311/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7205 - acc: 0.7056 - val_loss: 0.6617 - val_acc: 0.7056
Epoch 1312/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6868 - acc: 0.7056 - val_loss: 0.6616 - val_acc: 0.7056
Epoch 1313/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6853 - acc: 0.7042 - val_loss: 0.6627 - val_acc: 0.7056
Epoch 1314/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7005 - acc: 0.6972 - val_loss: 0.6639 - val_acc: 0.7056
Epoch 1315/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6872 - acc: 0.7083 - val_loss: 0.6649 - val_acc: 0.7167
Epoch 1316/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7027 - acc: 0.7028 - val_loss: 0.6656 - val_acc: 0.7222
Epoch 1317/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7191 - acc: 0.6792 - val_loss: 0.6664 - val_acc: 0.7167
Epoch 1318/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6845 - acc: 0.6986 - val_loss: 0.6679 - val_acc: 0.7278
Epoch 1319/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7008 - acc: 0.6958 - val_loss: 0.6690 - val_acc: 0.7278
Epoch 1320/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7017 - acc: 0.6986 - val_loss: 0.6699 - val_acc: 0.7222
Epoch 1321/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7037 - acc: 0.7028 - val_loss: 0.6702 - val_acc: 0.7167
Epoch 1322/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7230 - acc: 0.6764 - val_loss: 0.6704 - val_acc: 0.7167
Epoch 1323/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6875 - acc: 0.6931 - val_loss: 0.6706 - val_acc: 0.7167
Epoch 1324/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6897 - acc: 0.7097 - val_loss: 0.6709 - val_acc: 0.7167
Epoch 1325/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6950 - acc: 0.6986 - val_loss: 0.6716 - val_acc: 0.7111
Epoch 1326/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7042 - acc: 0.6903 - val_loss: 0.6726 - val_acc: 0.7056
Epoch 1327/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7078 - acc: 0.6958 - val_loss: 0.6749 - val_acc: 0.7056
Epoch 1328/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6971 - acc: 0.7042 - val_loss: 0.6754 - val_acc: 0.7056
Epoch 1329/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7193 - acc: 0.6819 - val_loss: 0.6741 - val_acc: 0.7056
Epoch 1330/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7014 - acc: 0.6944 - val_loss: 0.6726 - val_acc: 0.7056
Epoch 1331/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6859 - acc: 0.7111 - val_loss: 0.6720 - val_acc: 0.7056
Epoch 1332/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6778 - acc: 0.7153 - val_loss: 0.6715 - val_acc: 0.7056
Epoch 1333/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6968 - acc: 0.7056 - val_loss: 0.6708 - val_acc: 0.7056
Epoch 1334/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6965 - acc: 0.7014 - val_loss: 0.6697 - val_acc: 0.7000
Epoch 1335/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6819 - acc: 0.7208 - val_loss: 0.6681 - val_acc: 0.7111
Epoch 1336/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7091 - acc: 0.6931 - val_loss: 0.6672 - val_acc: 0.7111
Epoch 1337/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6790 - acc: 0.7153 - val_loss: 0.6665 - val_acc: 0.7111
Epoch 1338/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7000 - acc: 0.7042 - val_loss: 0.6657 - val_acc: 0.7111
Epoch 1339/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6955 - acc: 0.6958 - val_loss: 0.6651 - val_acc: 0.7111
Epoch 1340/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6928 - acc: 0.7125 - val_loss: 0.6640 - val_acc: 0.7056
Epoch 1341/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7163 - acc: 0.6931 - val_loss: 0.6626 - val_acc: 0.7056
Epoch 1342/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7025 - acc: 0.6861 - val_loss: 0.6618 - val_acc: 0.7111
Epoch 1343/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7197 - acc: 0.6944 - val_loss: 0.6613 - val_acc: 0.7222
Epoch 1344/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7045 - acc: 0.6861 - val_loss: 0.6614 - val_acc: 0.7278
Epoch 1345/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6983 - acc: 0.6903 - val_loss: 0.6619 - val_acc: 0.7278
Epoch 1346/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7113 - acc: 0.6889 - val_loss: 0.6632 - val_acc: 0.7278
Epoch 1347/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7250 - acc: 0.6903 - val_loss: 0.6640 - val_acc: 0.7278
Epoch 1348/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7109 - acc: 0.6806 - val_loss: 0.6643 - val_acc: 0.7278
Epoch 1349/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6840 - acc: 0.7222 - val_loss: 0.6650 - val_acc: 0.7278
Epoch 1350/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6889 - acc: 0.7000 - val_loss: 0.6653 - val_acc: 0.7278
Epoch 1351/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7025 - acc: 0.7000 - val_loss: 0.6654 - val_acc: 0.7278
Epoch 1352/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6941 - acc: 0.7000 - val_loss: 0.6648 - val_acc: 0.7278
Epoch 1353/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7247 - acc: 0.6903 - val_loss: 0.6642 - val_acc: 0.7278
Epoch 1354/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6629 - acc: 0.7264 - val_loss: 0.6640 - val_acc: 0.7278
Epoch 1355/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6988 - acc: 0.6972 - val_loss: 0.6640 - val_acc: 0.7278
Epoch 1356/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6970 - acc: 0.7042 - val_loss: 0.6642 - val_acc: 0.7222
Epoch 1357/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7041 - acc: 0.7014 - val_loss: 0.6644 - val_acc: 0.7222
Epoch 1358/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6855 - acc: 0.7097 - val_loss: 0.6647 - val_acc: 0.7278
Epoch 1359/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6997 - acc: 0.6917 - val_loss: 0.6649 - val_acc: 0.7278
Epoch 1360/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6934 - acc: 0.6931 - val_loss: 0.6651 - val_acc: 0.7278
Epoch 1361/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7100 - acc: 0.7125 - val_loss: 0.6652 - val_acc: 0.7222
Epoch 1362/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7019 - acc: 0.7139 - val_loss: 0.6653 - val_acc: 0.7167
Epoch 1363/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6862 - acc: 0.7097 - val_loss: 0.6656 - val_acc: 0.7167
Epoch 1364/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7095 - acc: 0.6889 - val_loss: 0.6666 - val_acc: 0.7167
Epoch 1365/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6887 - acc: 0.7042 - val_loss: 0.6672 - val_acc: 0.7167
Epoch 1366/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6896 - acc: 0.7000 - val_loss: 0.6682 - val_acc: 0.7222
Epoch 1367/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7002 - acc: 0.7056 - val_loss: 0.6694 - val_acc: 0.7222
Epoch 1368/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7034 - acc: 0.7000 - val_loss: 0.6697 - val_acc: 0.7167
Epoch 1369/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6890 - acc: 0.6861 - val_loss: 0.6699 - val_acc: 0.7167
Epoch 1370/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6963 - acc: 0.7056 - val_loss: 0.6706 - val_acc: 0.7167
Epoch 1371/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6862 - acc: 0.7014 - val_loss: 0.6715 - val_acc: 0.7111
Epoch 1372/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7066 - acc: 0.6903 - val_loss: 0.6732 - val_acc: 0.7111
Epoch 1373/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6801 - acc: 0.7097 - val_loss: 0.6746 - val_acc: 0.7167
Epoch 1374/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6885 - acc: 0.7056 - val_loss: 0.6764 - val_acc: 0.7167
Epoch 1375/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7069 - acc: 0.7083 - val_loss: 0.6789 - val_acc: 0.7167
Epoch 1376/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6854 - acc: 0.6917 - val_loss: 0.6810 - val_acc: 0.7111
Epoch 1377/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7056 - acc: 0.6986 - val_loss: 0.6824 - val_acc: 0.7111
Epoch 1378/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7052 - acc: 0.7069 - val_loss: 0.6831 - val_acc: 0.7111
Epoch 1379/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7194 - acc: 0.7028 - val_loss: 0.6833 - val_acc: 0.7111
Epoch 1380/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7248 - acc: 0.6958 - val_loss: 0.6825 - val_acc: 0.7111
Epoch 1381/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6751 - acc: 0.7139 - val_loss: 0.6815 - val_acc: 0.7111
Epoch 1382/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6908 - acc: 0.6944 - val_loss: 0.6812 - val_acc: 0.7111
Epoch 1383/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6986 - acc: 0.7125 - val_loss: 0.6795 - val_acc: 0.7167
Epoch 1384/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7050 - acc: 0.6986 - val_loss: 0.6770 - val_acc: 0.7167
Epoch 1385/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7056 - acc: 0.6736 - val_loss: 0.6732 - val_acc: 0.7167
Epoch 1386/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6909 - acc: 0.6889 - val_loss: 0.6706 - val_acc: 0.7222
Epoch 1387/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6997 - acc: 0.6806 - val_loss: 0.6688 - val_acc: 0.7167
Epoch 1388/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6828 - acc: 0.7167 - val_loss: 0.6669 - val_acc: 0.7111
Epoch 1389/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6969 - acc: 0.7028 - val_loss: 0.6650 - val_acc: 0.7111
Epoch 1390/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7003 - acc: 0.6958 - val_loss: 0.6626 - val_acc: 0.7056
Epoch 1391/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6898 - acc: 0.7125 - val_loss: 0.6605 - val_acc: 0.7056
Epoch 1392/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6869 - acc: 0.7097 - val_loss: 0.6595 - val_acc: 0.7167
Epoch 1393/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6896 - acc: 0.7139 - val_loss: 0.6588 - val_acc: 0.7167
Epoch 1394/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7149 - acc: 0.7069 - val_loss: 0.6586 - val_acc: 0.7167
Epoch 1395/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6875 - acc: 0.7236 - val_loss: 0.6583 - val_acc: 0.7111
Epoch 1396/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6927 - acc: 0.6986 - val_loss: 0.6581 - val_acc: 0.7111
Epoch 1397/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6969 - acc: 0.7139 - val_loss: 0.6577 - val_acc: 0.7111
Epoch 1398/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6835 - acc: 0.7111 - val_loss: 0.6574 - val_acc: 0.7111
Epoch 1399/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7029 - acc: 0.6931 - val_loss: 0.6569 - val_acc: 0.7056
Epoch 1400/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6812 - acc: 0.7042 - val_loss: 0.6565 - val_acc: 0.7000
Epoch 1401/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6843 - acc: 0.7014 - val_loss: 0.6560 - val_acc: 0.7000
Epoch 1402/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7071 - acc: 0.7083 - val_loss: 0.6562 - val_acc: 0.7000
Epoch 1403/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7023 - acc: 0.7194 - val_loss: 0.6563 - val_acc: 0.7000
Epoch 1404/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7074 - acc: 0.6944 - val_loss: 0.6561 - val_acc: 0.7000
Epoch 1405/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6835 - acc: 0.7125 - val_loss: 0.6559 - val_acc: 0.7167
Epoch 1406/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6958 - acc: 0.6944 - val_loss: 0.6560 - val_acc: 0.7167
Epoch 1407/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7195 - acc: 0.7069 - val_loss: 0.6564 - val_acc: 0.7167
Epoch 1408/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6919 - acc: 0.7069 - val_loss: 0.6569 - val_acc: 0.7167
Epoch 1409/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7001 - acc: 0.7042 - val_loss: 0.6571 - val_acc: 0.7167
Epoch 1410/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6994 - acc: 0.7000 - val_loss: 0.6575 - val_acc: 0.7167
Epoch 1411/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7015 - acc: 0.6917 - val_loss: 0.6579 - val_acc: 0.7167
Epoch 1412/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7044 - acc: 0.6944 - val_loss: 0.6585 - val_acc: 0.7167
Epoch 1413/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7235 - acc: 0.7000 - val_loss: 0.6592 - val_acc: 0.7167
Epoch 1414/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6892 - acc: 0.7042 - val_loss: 0.6600 - val_acc: 0.7167
Epoch 1415/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6880 - acc: 0.7125 - val_loss: 0.6607 - val_acc: 0.7167
Epoch 1416/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6801 - acc: 0.7139 - val_loss: 0.6612 - val_acc: 0.7222
Epoch 1417/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6858 - acc: 0.6931 - val_loss: 0.6616 - val_acc: 0.7222
Epoch 1418/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6944 - acc: 0.7125 - val_loss: 0.6620 - val_acc: 0.7167
Epoch 1419/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6943 - acc: 0.7139 - val_loss: 0.6625 - val_acc: 0.7278
Epoch 1420/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6999 - acc: 0.6944 - val_loss: 0.6633 - val_acc: 0.7278
Epoch 1421/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6918 - acc: 0.7194 - val_loss: 0.6641 - val_acc: 0.7278
Epoch 1422/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6874 - acc: 0.6944 - val_loss: 0.6652 - val_acc: 0.7278
Epoch 1423/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6833 - acc: 0.7292 - val_loss: 0.6656 - val_acc: 0.7278
Epoch 1424/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6927 - acc: 0.6986 - val_loss: 0.6658 - val_acc: 0.7278
Epoch 1425/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6926 - acc: 0.7028 - val_loss: 0.6664 - val_acc: 0.7167
Epoch 1426/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7212 - acc: 0.6903 - val_loss: 0.6665 - val_acc: 0.7167
Epoch 1427/3000
720/720 [==============================] - 0s 12us/step - loss: 0.7203 - acc: 0.6736 - val_loss: 0.6666 - val_acc: 0.7278
Epoch 1428/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6807 - acc: 0.7111 - val_loss: 0.6661 - val_acc: 0.7333
Epoch 1429/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6841 - acc: 0.7111 - val_loss: 0.6652 - val_acc: 0.7333
Epoch 1430/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7076 - acc: 0.6819 - val_loss: 0.6648 - val_acc: 0.7333
Epoch 1431/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6965 - acc: 0.6958 - val_loss: 0.6640 - val_acc: 0.7278
Epoch 1432/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6748 - acc: 0.7000 - val_loss: 0.6631 - val_acc: 0.7278
Epoch 1433/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6906 - acc: 0.7111 - val_loss: 0.6625 - val_acc: 0.7278
Epoch 1434/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6947 - acc: 0.7000 - val_loss: 0.6613 - val_acc: 0.7333
Epoch 1435/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6953 - acc: 0.7167 - val_loss: 0.6606 - val_acc: 0.7278
Epoch 1436/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6990 - acc: 0.6944 - val_loss: 0.6600 - val_acc: 0.7278
Epoch 1437/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6988 - acc: 0.6972 - val_loss: 0.6598 - val_acc: 0.7278
Epoch 1438/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6886 - acc: 0.7153 - val_loss: 0.6602 - val_acc: 0.7278
Epoch 1439/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6744 - acc: 0.7111 - val_loss: 0.6602 - val_acc: 0.7278
Epoch 1440/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6873 - acc: 0.7056 - val_loss: 0.6602 - val_acc: 0.7278
Epoch 1441/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7121 - acc: 0.6833 - val_loss: 0.6607 - val_acc: 0.7278
Epoch 1442/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7190 - acc: 0.7014 - val_loss: 0.6610 - val_acc: 0.7222
Epoch 1443/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6786 - acc: 0.7139 - val_loss: 0.6616 - val_acc: 0.7222
Epoch 1444/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6794 - acc: 0.7097 - val_loss: 0.6621 - val_acc: 0.7222
Epoch 1445/3000
720/720 [==============================] - 0s 32us/step - loss: 0.7160 - acc: 0.6903 - val_loss: 0.6628 - val_acc: 0.7278
Epoch 1446/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6927 - acc: 0.6792 - val_loss: 0.6639 - val_acc: 0.7222
Epoch 1447/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6802 - acc: 0.7194 - val_loss: 0.6649 - val_acc: 0.7222
Epoch 1448/3000
720/720 [==============================] - 0s 43us/step - loss: 0.7042 - acc: 0.7028 - val_loss: 0.6664 - val_acc: 0.7222
Epoch 1449/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6980 - acc: 0.7000 - val_loss: 0.6684 - val_acc: 0.7167
Epoch 1450/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6946 - acc: 0.6986 - val_loss: 0.6707 - val_acc: 0.7167
Epoch 1451/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6742 - acc: 0.7153 - val_loss: 0.6725 - val_acc: 0.7167
Epoch 1452/3000
720/720 [==============================] - 0s 33us/step - loss: 0.7037 - acc: 0.7125 - val_loss: 0.6745 - val_acc: 0.7111
Epoch 1453/3000
720/720 [==============================] - 0s 44us/step - loss: 0.6943 - acc: 0.6931 - val_loss: 0.6765 - val_acc: 0.7111
Epoch 1454/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6957 - acc: 0.7139 - val_loss: 0.6779 - val_acc: 0.7111
Epoch 1455/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6943 - acc: 0.7042 - val_loss: 0.6794 - val_acc: 0.7111
Epoch 1456/3000
720/720 [==============================] - 0s 42us/step - loss: 0.6891 - acc: 0.7236 - val_loss: 0.6799 - val_acc: 0.7111
Epoch 1457/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6971 - acc: 0.7014 - val_loss: 0.6806 - val_acc: 0.7222
Epoch 1458/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6988 - acc: 0.6972 - val_loss: 0.6794 - val_acc: 0.7111
Epoch 1459/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6850 - acc: 0.7056 - val_loss: 0.6791 - val_acc: 0.7167
Epoch 1460/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6927 - acc: 0.6903 - val_loss: 0.6787 - val_acc: 0.7167
Epoch 1461/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7047 - acc: 0.7014 - val_loss: 0.6781 - val_acc: 0.7167
Epoch 1462/3000
720/720 [==============================] - 0s 36us/step - loss: 0.6888 - acc: 0.7153 - val_loss: 0.6773 - val_acc: 0.7167
Epoch 1463/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6717 - acc: 0.7236 - val_loss: 0.6765 - val_acc: 0.7167
Epoch 1464/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6883 - acc: 0.7069 - val_loss: 0.6763 - val_acc: 0.7167
Epoch 1465/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7083 - acc: 0.6931 - val_loss: 0.6741 - val_acc: 0.7111
Epoch 1466/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6956 - acc: 0.6944 - val_loss: 0.6729 - val_acc: 0.7111
Epoch 1467/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6718 - acc: 0.7181 - val_loss: 0.6714 - val_acc: 0.7111
Epoch 1468/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7039 - acc: 0.6903 - val_loss: 0.6703 - val_acc: 0.7167
Epoch 1469/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6961 - acc: 0.7028 - val_loss: 0.6681 - val_acc: 0.7222
Epoch 1470/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6872 - acc: 0.7056 - val_loss: 0.6657 - val_acc: 0.7222
Epoch 1471/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6778 - acc: 0.6944 - val_loss: 0.6640 - val_acc: 0.7222
Epoch 1472/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6918 - acc: 0.6972 - val_loss: 0.6625 - val_acc: 0.7278
Epoch 1473/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6658 - acc: 0.7347 - val_loss: 0.6613 - val_acc: 0.7278
Epoch 1474/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6860 - acc: 0.7208 - val_loss: 0.6608 - val_acc: 0.7278
Epoch 1475/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7151 - acc: 0.6986 - val_loss: 0.6605 - val_acc: 0.7333
Epoch 1476/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7038 - acc: 0.6903 - val_loss: 0.6599 - val_acc: 0.7278
Epoch 1477/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6948 - acc: 0.7056 - val_loss: 0.6593 - val_acc: 0.7222
Epoch 1478/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6978 - acc: 0.7125 - val_loss: 0.6591 - val_acc: 0.7222
Epoch 1479/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7045 - acc: 0.6972 - val_loss: 0.6583 - val_acc: 0.7167
Epoch 1480/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6934 - acc: 0.7056 - val_loss: 0.6579 - val_acc: 0.7222
Epoch 1481/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6927 - acc: 0.7056 - val_loss: 0.6579 - val_acc: 0.7056
Epoch 1482/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6959 - acc: 0.6944 - val_loss: 0.6586 - val_acc: 0.7056
Epoch 1483/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6801 - acc: 0.7111 - val_loss: 0.6587 - val_acc: 0.7056
Epoch 1484/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7022 - acc: 0.6944 - val_loss: 0.6581 - val_acc: 0.7056
Epoch 1485/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7007 - acc: 0.6861 - val_loss: 0.6585 - val_acc: 0.7056
Epoch 1486/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6850 - acc: 0.7083 - val_loss: 0.6602 - val_acc: 0.7056
Epoch 1487/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6997 - acc: 0.7028 - val_loss: 0.6622 - val_acc: 0.7056
Epoch 1488/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6830 - acc: 0.7153 - val_loss: 0.6651 - val_acc: 0.7056
Epoch 1489/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7195 - acc: 0.7069 - val_loss: 0.6673 - val_acc: 0.7056
Epoch 1490/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7049 - acc: 0.6958 - val_loss: 0.6682 - val_acc: 0.7000
Epoch 1491/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6892 - acc: 0.7056 - val_loss: 0.6683 - val_acc: 0.7000
Epoch 1492/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6678 - acc: 0.7097 - val_loss: 0.6681 - val_acc: 0.7000
Epoch 1493/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7101 - acc: 0.6931 - val_loss: 0.6684 - val_acc: 0.7000
Epoch 1494/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6773 - acc: 0.7069 - val_loss: 0.6689 - val_acc: 0.7000
Epoch 1495/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6835 - acc: 0.6972 - val_loss: 0.6688 - val_acc: 0.7056
Epoch 1496/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6833 - acc: 0.7014 - val_loss: 0.6687 - val_acc: 0.7056
Epoch 1497/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6774 - acc: 0.7083 - val_loss: 0.6689 - val_acc: 0.7056
Epoch 1498/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6897 - acc: 0.6903 - val_loss: 0.6671 - val_acc: 0.7056
Epoch 1499/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6711 - acc: 0.7014 - val_loss: 0.6648 - val_acc: 0.7000
Epoch 1500/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6963 - acc: 0.7125 - val_loss: 0.6629 - val_acc: 0.7000
Epoch 1501/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6936 - acc: 0.7139 - val_loss: 0.6611 - val_acc: 0.7000
Epoch 1502/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6992 - acc: 0.7042 - val_loss: 0.6600 - val_acc: 0.7000
Epoch 1503/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6817 - acc: 0.7056 - val_loss: 0.6594 - val_acc: 0.7056
Epoch 1504/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6837 - acc: 0.7153 - val_loss: 0.6585 - val_acc: 0.7056
Epoch 1505/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6808 - acc: 0.7083 - val_loss: 0.6578 - val_acc: 0.7056
Epoch 1506/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6866 - acc: 0.7167 - val_loss: 0.6574 - val_acc: 0.7056
Epoch 1507/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6786 - acc: 0.7056 - val_loss: 0.6574 - val_acc: 0.7056
Epoch 1508/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6916 - acc: 0.7069 - val_loss: 0.6576 - val_acc: 0.7056
Epoch 1509/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6842 - acc: 0.7042 - val_loss: 0.6574 - val_acc: 0.7056
Epoch 1510/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6824 - acc: 0.7125 - val_loss: 0.6578 - val_acc: 0.7056
Epoch 1511/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6935 - acc: 0.7069 - val_loss: 0.6580 - val_acc: 0.7056
Epoch 1512/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6842 - acc: 0.7056 - val_loss: 0.6582 - val_acc: 0.7111
Epoch 1513/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6964 - acc: 0.6958 - val_loss: 0.6586 - val_acc: 0.7111
Epoch 1514/3000
720/720 [==============================] - 0s 37us/step - loss: 0.7011 - acc: 0.7125 - val_loss: 0.6604 - val_acc: 0.7111
Epoch 1515/3000
720/720 [==============================] - 0s 42us/step - loss: 0.6910 - acc: 0.7125 - val_loss: 0.6623 - val_acc: 0.7111
Epoch 1516/3000
720/720 [==============================] - 0s 46us/step - loss: 0.6879 - acc: 0.7069 - val_loss: 0.6647 - val_acc: 0.7056
Epoch 1517/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6997 - acc: 0.7028 - val_loss: 0.6664 - val_acc: 0.7056
Epoch 1518/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6806 - acc: 0.7069 - val_loss: 0.6664 - val_acc: 0.7056
Epoch 1519/3000
720/720 [==============================] - 0s 36us/step - loss: 0.6793 - acc: 0.7208 - val_loss: 0.6651 - val_acc: 0.7056
Epoch 1520/3000
720/720 [==============================] - 0s 32us/step - loss: 0.7043 - acc: 0.6958 - val_loss: 0.6650 - val_acc: 0.7056
Epoch 1521/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6943 - acc: 0.7014 - val_loss: 0.6647 - val_acc: 0.7111
Epoch 1522/3000
720/720 [==============================] - 0s 36us/step - loss: 0.7144 - acc: 0.6986 - val_loss: 0.6638 - val_acc: 0.7056
Epoch 1523/3000
720/720 [==============================] - 0s 40us/step - loss: 0.6823 - acc: 0.7083 - val_loss: 0.6644 - val_acc: 0.7056
Epoch 1524/3000
720/720 [==============================] - 0s 42us/step - loss: 0.6980 - acc: 0.6958 - val_loss: 0.6646 - val_acc: 0.7056
Epoch 1525/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6993 - acc: 0.7097 - val_loss: 0.6643 - val_acc: 0.7056
Epoch 1526/3000
720/720 [==============================] - 0s 33us/step - loss: 0.7012 - acc: 0.7014 - val_loss: 0.6639 - val_acc: 0.7056
Epoch 1527/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6989 - acc: 0.6986 - val_loss: 0.6633 - val_acc: 0.7056
Epoch 1528/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6949 - acc: 0.6958 - val_loss: 0.6628 - val_acc: 0.7056
Epoch 1529/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6948 - acc: 0.7125 - val_loss: 0.6635 - val_acc: 0.7056
Epoch 1530/3000
720/720 [==============================] - 0s 35us/step - loss: 0.7076 - acc: 0.7028 - val_loss: 0.6632 - val_acc: 0.7056
Epoch 1531/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7044 - acc: 0.7042 - val_loss: 0.6633 - val_acc: 0.7111
Epoch 1532/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6912 - acc: 0.7069 - val_loss: 0.6634 - val_acc: 0.7111
Epoch 1533/3000
720/720 [==============================] - 0s 39us/step - loss: 0.6895 - acc: 0.7111 - val_loss: 0.6627 - val_acc: 0.7111
Epoch 1534/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6954 - acc: 0.7014 - val_loss: 0.6630 - val_acc: 0.7111
Epoch 1535/3000
720/720 [==============================] - 0s 40us/step - loss: 0.6970 - acc: 0.6889 - val_loss: 0.6632 - val_acc: 0.7111
Epoch 1536/3000
720/720 [==============================] - 0s 47us/step - loss: 0.6951 - acc: 0.6833 - val_loss: 0.6629 - val_acc: 0.7111
Epoch 1537/3000
720/720 [==============================] - 0s 42us/step - loss: 0.6965 - acc: 0.7069 - val_loss: 0.6631 - val_acc: 0.7111
Epoch 1538/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6890 - acc: 0.6986 - val_loss: 0.6630 - val_acc: 0.7111
Epoch 1539/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6937 - acc: 0.7097 - val_loss: 0.6636 - val_acc: 0.7111
Epoch 1540/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6942 - acc: 0.6931 - val_loss: 0.6643 - val_acc: 0.7111
Epoch 1541/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6827 - acc: 0.7125 - val_loss: 0.6642 - val_acc: 0.7111
Epoch 1542/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6873 - acc: 0.7125 - val_loss: 0.6629 - val_acc: 0.7111
Epoch 1543/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6749 - acc: 0.7111 - val_loss: 0.6620 - val_acc: 0.7111
Epoch 1544/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6865 - acc: 0.7111 - val_loss: 0.6611 - val_acc: 0.7111
Epoch 1545/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6812 - acc: 0.7042 - val_loss: 0.6599 - val_acc: 0.7111
Epoch 1546/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6793 - acc: 0.7181 - val_loss: 0.6587 - val_acc: 0.7111
Epoch 1547/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6804 - acc: 0.6903 - val_loss: 0.6573 - val_acc: 0.7111
Epoch 1548/3000
720/720 [==============================] - 0s 21us/step - loss: 0.7009 - acc: 0.7097 - val_loss: 0.6553 - val_acc: 0.7111
Epoch 1549/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7073 - acc: 0.6931 - val_loss: 0.6543 - val_acc: 0.7167
Epoch 1550/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6939 - acc: 0.7097 - val_loss: 0.6533 - val_acc: 0.7167
Epoch 1551/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7281 - acc: 0.6903 - val_loss: 0.6522 - val_acc: 0.7222
Epoch 1552/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6879 - acc: 0.7014 - val_loss: 0.6513 - val_acc: 0.7222
Epoch 1553/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6813 - acc: 0.6958 - val_loss: 0.6513 - val_acc: 0.7278
Epoch 1554/3000
720/720 [==============================] - 0s 24us/step - loss: 0.7034 - acc: 0.7056 - val_loss: 0.6515 - val_acc: 0.7278
Epoch 1555/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7053 - acc: 0.7000 - val_loss: 0.6516 - val_acc: 0.7278
Epoch 1556/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6919 - acc: 0.7000 - val_loss: 0.6517 - val_acc: 0.7333
Epoch 1557/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6792 - acc: 0.7028 - val_loss: 0.6520 - val_acc: 0.7333
Epoch 1558/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6848 - acc: 0.7083 - val_loss: 0.6528 - val_acc: 0.7278
Epoch 1559/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6836 - acc: 0.7194 - val_loss: 0.6541 - val_acc: 0.7278
Epoch 1560/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6708 - acc: 0.7056 - val_loss: 0.6560 - val_acc: 0.7222
Epoch 1561/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6989 - acc: 0.6986 - val_loss: 0.6577 - val_acc: 0.7111
Epoch 1562/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6782 - acc: 0.6875 - val_loss: 0.6596 - val_acc: 0.7111
Epoch 1563/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6943 - acc: 0.6944 - val_loss: 0.6616 - val_acc: 0.7111
Epoch 1564/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6871 - acc: 0.7111 - val_loss: 0.6638 - val_acc: 0.7111
Epoch 1565/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6777 - acc: 0.6958 - val_loss: 0.6661 - val_acc: 0.7111
Epoch 1566/3000
720/720 [==============================] - 0s 44us/step - loss: 0.6826 - acc: 0.7125 - val_loss: 0.6682 - val_acc: 0.7111
Epoch 1567/3000
720/720 [==============================] - 0s 44us/step - loss: 0.6847 - acc: 0.6972 - val_loss: 0.6701 - val_acc: 0.7000
Epoch 1568/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6901 - acc: 0.7028 - val_loss: 0.6717 - val_acc: 0.7000
Epoch 1569/3000
720/720 [==============================] - 0s 36us/step - loss: 0.7034 - acc: 0.6931 - val_loss: 0.6742 - val_acc: 0.7056
Epoch 1570/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6792 - acc: 0.7028 - val_loss: 0.6743 - val_acc: 0.7056
Epoch 1571/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6804 - acc: 0.7139 - val_loss: 0.6742 - val_acc: 0.7056
Epoch 1572/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6969 - acc: 0.7028 - val_loss: 0.6735 - val_acc: 0.7000
Epoch 1573/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6866 - acc: 0.7278 - val_loss: 0.6712 - val_acc: 0.7000
Epoch 1574/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6776 - acc: 0.7028 - val_loss: 0.6675 - val_acc: 0.7000
Epoch 1575/3000
720/720 [==============================] - 0s 36us/step - loss: 0.6858 - acc: 0.7125 - val_loss: 0.6643 - val_acc: 0.7056
Epoch 1576/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6978 - acc: 0.7069 - val_loss: 0.6620 - val_acc: 0.7000
Epoch 1577/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6920 - acc: 0.7000 - val_loss: 0.6595 - val_acc: 0.7000
Epoch 1578/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6611 - acc: 0.7181 - val_loss: 0.6574 - val_acc: 0.7000
Epoch 1579/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6669 - acc: 0.7083 - val_loss: 0.6557 - val_acc: 0.7000
Epoch 1580/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6706 - acc: 0.6986 - val_loss: 0.6541 - val_acc: 0.7056
Epoch 1581/3000
720/720 [==============================] - 0s 44us/step - loss: 0.6788 - acc: 0.7014 - val_loss: 0.6530 - val_acc: 0.7056
Epoch 1582/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6843 - acc: 0.7042 - val_loss: 0.6524 - val_acc: 0.7056
Epoch 1583/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7062 - acc: 0.6875 - val_loss: 0.6522 - val_acc: 0.7000
Epoch 1584/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7079 - acc: 0.6944 - val_loss: 0.6523 - val_acc: 0.7000
Epoch 1585/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6978 - acc: 0.6972 - val_loss: 0.6525 - val_acc: 0.6944
Epoch 1586/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6828 - acc: 0.7139 - val_loss: 0.6526 - val_acc: 0.6944
Epoch 1587/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6818 - acc: 0.6944 - val_loss: 0.6529 - val_acc: 0.6944
Epoch 1588/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6778 - acc: 0.7208 - val_loss: 0.6531 - val_acc: 0.6944
Epoch 1589/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6763 - acc: 0.7083 - val_loss: 0.6533 - val_acc: 0.6944
Epoch 1590/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6726 - acc: 0.7125 - val_loss: 0.6536 - val_acc: 0.6944
Epoch 1591/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6979 - acc: 0.6944 - val_loss: 0.6537 - val_acc: 0.6944
Epoch 1592/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6946 - acc: 0.7097 - val_loss: 0.6536 - val_acc: 0.6944
Epoch 1593/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6944 - acc: 0.7000 - val_loss: 0.6534 - val_acc: 0.7000
Epoch 1594/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6987 - acc: 0.7153 - val_loss: 0.6530 - val_acc: 0.7000
Epoch 1595/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6705 - acc: 0.7069 - val_loss: 0.6531 - val_acc: 0.7000
Epoch 1596/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6894 - acc: 0.7056 - val_loss: 0.6533 - val_acc: 0.7056
Epoch 1597/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6996 - acc: 0.7000 - val_loss: 0.6536 - val_acc: 0.7111
Epoch 1598/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6830 - acc: 0.7125 - val_loss: 0.6541 - val_acc: 0.7111
Epoch 1599/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7079 - acc: 0.6986 - val_loss: 0.6551 - val_acc: 0.7056
Epoch 1600/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6792 - acc: 0.7042 - val_loss: 0.6563 - val_acc: 0.7056
Epoch 1601/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7377 - acc: 0.6875 - val_loss: 0.6572 - val_acc: 0.7056
Epoch 1602/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6934 - acc: 0.6972 - val_loss: 0.6579 - val_acc: 0.7056
Epoch 1603/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6714 - acc: 0.7111 - val_loss: 0.6587 - val_acc: 0.7056
Epoch 1604/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6821 - acc: 0.7153 - val_loss: 0.6591 - val_acc: 0.7056
Epoch 1605/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6973 - acc: 0.7000 - val_loss: 0.6593 - val_acc: 0.7056
Epoch 1606/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6794 - acc: 0.6903 - val_loss: 0.6595 - val_acc: 0.7056
Epoch 1607/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6980 - acc: 0.7014 - val_loss: 0.6596 - val_acc: 0.7056
Epoch 1608/3000
720/720 [==============================] - 0s 40us/step - loss: 0.6850 - acc: 0.7153 - val_loss: 0.6597 - val_acc: 0.7056
Epoch 1609/3000
720/720 [==============================] - 0s 38us/step - loss: 0.6809 - acc: 0.6986 - val_loss: 0.6604 - val_acc: 0.7056
Epoch 1610/3000
720/720 [==============================] - 0s 40us/step - loss: 0.6804 - acc: 0.7000 - val_loss: 0.6611 - val_acc: 0.7056
Epoch 1611/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6838 - acc: 0.7111 - val_loss: 0.6618 - val_acc: 0.7000
Epoch 1612/3000
720/720 [==============================] - 0s 35us/step - loss: 0.7080 - acc: 0.7042 - val_loss: 0.6628 - val_acc: 0.7000
Epoch 1613/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6747 - acc: 0.7097 - val_loss: 0.6634 - val_acc: 0.7000
Epoch 1614/3000
720/720 [==============================] - 0s 36us/step - loss: 0.7040 - acc: 0.6972 - val_loss: 0.6638 - val_acc: 0.6944
Epoch 1615/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6819 - acc: 0.7014 - val_loss: 0.6644 - val_acc: 0.6944
Epoch 1616/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6872 - acc: 0.6986 - val_loss: 0.6654 - val_acc: 0.6944
Epoch 1617/3000
720/720 [==============================] - 0s 38us/step - loss: 0.6724 - acc: 0.7069 - val_loss: 0.6664 - val_acc: 0.6944
Epoch 1618/3000
720/720 [==============================] - 0s 42us/step - loss: 0.7179 - acc: 0.7000 - val_loss: 0.6669 - val_acc: 0.6944
Epoch 1619/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6765 - acc: 0.7194 - val_loss: 0.6670 - val_acc: 0.6944
Epoch 1620/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6723 - acc: 0.7125 - val_loss: 0.6676 - val_acc: 0.6944
Epoch 1621/3000
720/720 [==============================] - 0s 36us/step - loss: 0.7041 - acc: 0.7042 - val_loss: 0.6684 - val_acc: 0.6944
Epoch 1622/3000
720/720 [==============================] - 0s 43us/step - loss: 0.7204 - acc: 0.6903 - val_loss: 0.6702 - val_acc: 0.7000
Epoch 1623/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6998 - acc: 0.6986 - val_loss: 0.6722 - val_acc: 0.6944
Epoch 1624/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6877 - acc: 0.7042 - val_loss: 0.6734 - val_acc: 0.6944
Epoch 1625/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6844 - acc: 0.7125 - val_loss: 0.6738 - val_acc: 0.6944
Epoch 1626/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6643 - acc: 0.7236 - val_loss: 0.6746 - val_acc: 0.7111
Epoch 1627/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7000 - acc: 0.6944 - val_loss: 0.6742 - val_acc: 0.7111
Epoch 1628/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6770 - acc: 0.7069 - val_loss: 0.6736 - val_acc: 0.7111
Epoch 1629/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6773 - acc: 0.7083 - val_loss: 0.6712 - val_acc: 0.7167
Epoch 1630/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6645 - acc: 0.7167 - val_loss: 0.6691 - val_acc: 0.7111
Epoch 1631/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6857 - acc: 0.6986 - val_loss: 0.6674 - val_acc: 0.7222
Epoch 1632/3000
720/720 [==============================] - 0s 21us/step - loss: 0.7007 - acc: 0.7097 - val_loss: 0.6662 - val_acc: 0.7222
Epoch 1633/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6939 - acc: 0.6875 - val_loss: 0.6645 - val_acc: 0.7222
Epoch 1634/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6873 - acc: 0.7014 - val_loss: 0.6633 - val_acc: 0.7222
Epoch 1635/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6943 - acc: 0.7014 - val_loss: 0.6625 - val_acc: 0.7222
Epoch 1636/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6916 - acc: 0.7042 - val_loss: 0.6615 - val_acc: 0.7222
Epoch 1637/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6804 - acc: 0.7014 - val_loss: 0.6602 - val_acc: 0.7222
Epoch 1638/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6850 - acc: 0.7069 - val_loss: 0.6598 - val_acc: 0.7222
Epoch 1639/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6736 - acc: 0.7208 - val_loss: 0.6595 - val_acc: 0.7278
Epoch 1640/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6960 - acc: 0.7181 - val_loss: 0.6595 - val_acc: 0.7278
Epoch 1641/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6877 - acc: 0.6986 - val_loss: 0.6597 - val_acc: 0.7278
Epoch 1642/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7219 - acc: 0.6944 - val_loss: 0.6596 - val_acc: 0.7333
Epoch 1643/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6782 - acc: 0.7083 - val_loss: 0.6596 - val_acc: 0.7333
Epoch 1644/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6860 - acc: 0.7319 - val_loss: 0.6593 - val_acc: 0.7333
Epoch 1645/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6844 - acc: 0.7167 - val_loss: 0.6589 - val_acc: 0.7333
Epoch 1646/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6919 - acc: 0.7167 - val_loss: 0.6581 - val_acc: 0.7278
Epoch 1647/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6942 - acc: 0.7056 - val_loss: 0.6575 - val_acc: 0.7222
Epoch 1648/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6844 - acc: 0.6986 - val_loss: 0.6571 - val_acc: 0.7167
Epoch 1649/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6658 - acc: 0.7056 - val_loss: 0.6575 - val_acc: 0.7167
Epoch 1650/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6855 - acc: 0.7097 - val_loss: 0.6583 - val_acc: 0.7222
Epoch 1651/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6784 - acc: 0.7111 - val_loss: 0.6590 - val_acc: 0.7278
Epoch 1652/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6846 - acc: 0.6972 - val_loss: 0.6601 - val_acc: 0.7278
Epoch 1653/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6782 - acc: 0.6958 - val_loss: 0.6613 - val_acc: 0.7278
Epoch 1654/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6900 - acc: 0.7083 - val_loss: 0.6623 - val_acc: 0.7333
Epoch 1655/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6955 - acc: 0.6972 - val_loss: 0.6637 - val_acc: 0.7333
Epoch 1656/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6961 - acc: 0.7000 - val_loss: 0.6657 - val_acc: 0.7278
Epoch 1657/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6752 - acc: 0.7083 - val_loss: 0.6675 - val_acc: 0.7222
Epoch 1658/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6676 - acc: 0.7083 - val_loss: 0.6698 - val_acc: 0.7222
Epoch 1659/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6909 - acc: 0.7153 - val_loss: 0.6725 - val_acc: 0.7167
Epoch 1660/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6879 - acc: 0.7153 - val_loss: 0.6757 - val_acc: 0.7167
Epoch 1661/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6812 - acc: 0.7028 - val_loss: 0.6783 - val_acc: 0.7167
Epoch 1662/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6926 - acc: 0.7111 - val_loss: 0.6792 - val_acc: 0.7056
Epoch 1663/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6759 - acc: 0.7069 - val_loss: 0.6800 - val_acc: 0.7000
Epoch 1664/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7023 - acc: 0.7167 - val_loss: 0.6805 - val_acc: 0.6944
Epoch 1665/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6709 - acc: 0.7069 - val_loss: 0.6810 - val_acc: 0.6889
Epoch 1666/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6951 - acc: 0.6944 - val_loss: 0.6794 - val_acc: 0.6944
Epoch 1667/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6810 - acc: 0.7097 - val_loss: 0.6789 - val_acc: 0.6889
Epoch 1668/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6907 - acc: 0.7028 - val_loss: 0.6783 - val_acc: 0.6889
Epoch 1669/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6953 - acc: 0.7083 - val_loss: 0.6780 - val_acc: 0.6944
Epoch 1670/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6857 - acc: 0.7056 - val_loss: 0.6776 - val_acc: 0.6889
Epoch 1671/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6816 - acc: 0.7000 - val_loss: 0.6775 - val_acc: 0.6889
Epoch 1672/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6661 - acc: 0.7139 - val_loss: 0.6772 - val_acc: 0.6944
Epoch 1673/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6868 - acc: 0.7250 - val_loss: 0.6760 - val_acc: 0.7000
Epoch 1674/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6858 - acc: 0.6917 - val_loss: 0.6749 - val_acc: 0.7000
Epoch 1675/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6597 - acc: 0.7125 - val_loss: 0.6732 - val_acc: 0.7056
Epoch 1676/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7061 - acc: 0.6986 - val_loss: 0.6720 - val_acc: 0.7056
Epoch 1677/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6771 - acc: 0.7139 - val_loss: 0.6706 - val_acc: 0.7056
Epoch 1678/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6864 - acc: 0.7042 - val_loss: 0.6691 - val_acc: 0.7111
Epoch 1679/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6935 - acc: 0.7083 - val_loss: 0.6672 - val_acc: 0.7167
Epoch 1680/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6862 - acc: 0.7139 - val_loss: 0.6649 - val_acc: 0.7167
Epoch 1681/3000
720/720 [==============================] - 0s 13us/step - loss: 0.7012 - acc: 0.7028 - val_loss: 0.6636 - val_acc: 0.7167
Epoch 1682/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6852 - acc: 0.7028 - val_loss: 0.6621 - val_acc: 0.7167
Epoch 1683/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6726 - acc: 0.7056 - val_loss: 0.6608 - val_acc: 0.7111
Epoch 1684/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6806 - acc: 0.7083 - val_loss: 0.6595 - val_acc: 0.7111
Epoch 1685/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6778 - acc: 0.7083 - val_loss: 0.6588 - val_acc: 0.7111
Epoch 1686/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6781 - acc: 0.7208 - val_loss: 0.6580 - val_acc: 0.7111
Epoch 1687/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6879 - acc: 0.7139 - val_loss: 0.6580 - val_acc: 0.7111
Epoch 1688/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6947 - acc: 0.7236 - val_loss: 0.6573 - val_acc: 0.7111
Epoch 1689/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6984 - acc: 0.6931 - val_loss: 0.6567 - val_acc: 0.7278
Epoch 1690/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6715 - acc: 0.7111 - val_loss: 0.6559 - val_acc: 0.7278
Epoch 1691/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6679 - acc: 0.7278 - val_loss: 0.6553 - val_acc: 0.7278
Epoch 1692/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6911 - acc: 0.7083 - val_loss: 0.6546 - val_acc: 0.7278
Epoch 1693/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6838 - acc: 0.7208 - val_loss: 0.6539 - val_acc: 0.7278
Epoch 1694/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6747 - acc: 0.7153 - val_loss: 0.6531 - val_acc: 0.7222
Epoch 1695/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6827 - acc: 0.7125 - val_loss: 0.6524 - val_acc: 0.7167
Epoch 1696/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6863 - acc: 0.7000 - val_loss: 0.6512 - val_acc: 0.7222
Epoch 1697/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6831 - acc: 0.7181 - val_loss: 0.6505 - val_acc: 0.7167
Epoch 1698/3000
720/720 [==============================] - 0s 37us/step - loss: 0.6827 - acc: 0.6958 - val_loss: 0.6500 - val_acc: 0.7167
Epoch 1699/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6818 - acc: 0.7111 - val_loss: 0.6501 - val_acc: 0.7167
Epoch 1700/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6635 - acc: 0.7208 - val_loss: 0.6506 - val_acc: 0.7167
Epoch 1701/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6828 - acc: 0.7000 - val_loss: 0.6511 - val_acc: 0.7278
Epoch 1702/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6851 - acc: 0.6903 - val_loss: 0.6513 - val_acc: 0.7278
Epoch 1703/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6681 - acc: 0.7194 - val_loss: 0.6514 - val_acc: 0.7278
Epoch 1704/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7041 - acc: 0.6931 - val_loss: 0.6514 - val_acc: 0.7222
Epoch 1705/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6958 - acc: 0.7153 - val_loss: 0.6511 - val_acc: 0.7222
Epoch 1706/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6702 - acc: 0.7264 - val_loss: 0.6510 - val_acc: 0.7278
Epoch 1707/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6731 - acc: 0.6944 - val_loss: 0.6510 - val_acc: 0.7333
Epoch 1708/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6788 - acc: 0.6944 - val_loss: 0.6514 - val_acc: 0.7333
Epoch 1709/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6791 - acc: 0.7125 - val_loss: 0.6523 - val_acc: 0.7333
Epoch 1710/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6989 - acc: 0.7153 - val_loss: 0.6530 - val_acc: 0.7333
Epoch 1711/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6827 - acc: 0.7014 - val_loss: 0.6541 - val_acc: 0.7333
Epoch 1712/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6809 - acc: 0.6986 - val_loss: 0.6555 - val_acc: 0.7222
Epoch 1713/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6900 - acc: 0.7125 - val_loss: 0.6570 - val_acc: 0.7167
Epoch 1714/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6752 - acc: 0.6972 - val_loss: 0.6589 - val_acc: 0.7167
Epoch 1715/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6745 - acc: 0.7069 - val_loss: 0.6612 - val_acc: 0.7167
Epoch 1716/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7051 - acc: 0.7111 - val_loss: 0.6657 - val_acc: 0.7222
Epoch 1717/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6814 - acc: 0.7042 - val_loss: 0.6690 - val_acc: 0.7222
Epoch 1718/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6806 - acc: 0.7181 - val_loss: 0.6713 - val_acc: 0.7167
Epoch 1719/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6993 - acc: 0.6917 - val_loss: 0.6718 - val_acc: 0.7167
Epoch 1720/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6723 - acc: 0.7153 - val_loss: 0.6723 - val_acc: 0.7222
Epoch 1721/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6826 - acc: 0.7083 - val_loss: 0.6724 - val_acc: 0.7167
Epoch 1722/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7014 - acc: 0.7056 - val_loss: 0.6713 - val_acc: 0.7222
Epoch 1723/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6844 - acc: 0.7042 - val_loss: 0.6698 - val_acc: 0.7222
Epoch 1724/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6696 - acc: 0.7153 - val_loss: 0.6687 - val_acc: 0.7222
Epoch 1725/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6802 - acc: 0.7014 - val_loss: 0.6687 - val_acc: 0.7222
Epoch 1726/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6842 - acc: 0.7056 - val_loss: 0.6685 - val_acc: 0.7222
Epoch 1727/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6846 - acc: 0.7111 - val_loss: 0.6681 - val_acc: 0.7222
Epoch 1728/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6843 - acc: 0.7167 - val_loss: 0.6684 - val_acc: 0.7222
Epoch 1729/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6730 - acc: 0.7111 - val_loss: 0.6687 - val_acc: 0.7222
Epoch 1730/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6689 - acc: 0.7097 - val_loss: 0.6689 - val_acc: 0.7222
Epoch 1731/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6842 - acc: 0.7097 - val_loss: 0.6686 - val_acc: 0.7222
Epoch 1732/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6935 - acc: 0.6917 - val_loss: 0.6688 - val_acc: 0.7222
Epoch 1733/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6850 - acc: 0.7042 - val_loss: 0.6689 - val_acc: 0.7222
Epoch 1734/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6726 - acc: 0.7167 - val_loss: 0.6692 - val_acc: 0.7222
Epoch 1735/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6899 - acc: 0.7056 - val_loss: 0.6690 - val_acc: 0.7222
Epoch 1736/3000
720/720 [==============================] - 0s 42us/step - loss: 0.6875 - acc: 0.6944 - val_loss: 0.6683 - val_acc: 0.7222
Epoch 1737/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6844 - acc: 0.7153 - val_loss: 0.6684 - val_acc: 0.7222
Epoch 1738/3000
720/720 [==============================] - 0s 42us/step - loss: 0.6751 - acc: 0.6986 - val_loss: 0.6679 - val_acc: 0.7222
Epoch 1739/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6842 - acc: 0.7014 - val_loss: 0.6672 - val_acc: 0.7222
Epoch 1740/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6630 - acc: 0.7222 - val_loss: 0.6665 - val_acc: 0.7167
Epoch 1741/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6796 - acc: 0.6931 - val_loss: 0.6666 - val_acc: 0.7111
Epoch 1742/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6893 - acc: 0.7111 - val_loss: 0.6670 - val_acc: 0.7167
Epoch 1743/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6718 - acc: 0.7167 - val_loss: 0.6656 - val_acc: 0.7167
Epoch 1744/3000
720/720 [==============================] - 0s 31us/step - loss: 0.7065 - acc: 0.6847 - val_loss: 0.6653 - val_acc: 0.7167
Epoch 1745/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6876 - acc: 0.7042 - val_loss: 0.6646 - val_acc: 0.7167
Epoch 1746/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6637 - acc: 0.7375 - val_loss: 0.6639 - val_acc: 0.7167
Epoch 1747/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6736 - acc: 0.7167 - val_loss: 0.6634 - val_acc: 0.7167
Epoch 1748/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6724 - acc: 0.7111 - val_loss: 0.6628 - val_acc: 0.7167
Epoch 1749/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6974 - acc: 0.6889 - val_loss: 0.6635 - val_acc: 0.7167
Epoch 1750/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6788 - acc: 0.7014 - val_loss: 0.6645 - val_acc: 0.7167
Epoch 1751/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6858 - acc: 0.7069 - val_loss: 0.6657 - val_acc: 0.7167
Epoch 1752/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6666 - acc: 0.7194 - val_loss: 0.6656 - val_acc: 0.7167
Epoch 1753/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6655 - acc: 0.7153 - val_loss: 0.6648 - val_acc: 0.7167
Epoch 1754/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6809 - acc: 0.7000 - val_loss: 0.6643 - val_acc: 0.7167
Epoch 1755/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6875 - acc: 0.7069 - val_loss: 0.6641 - val_acc: 0.7167
Epoch 1756/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6814 - acc: 0.6986 - val_loss: 0.6638 - val_acc: 0.7167
Epoch 1757/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6708 - acc: 0.7208 - val_loss: 0.6637 - val_acc: 0.7222
Epoch 1758/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6734 - acc: 0.7194 - val_loss: 0.6630 - val_acc: 0.7167
Epoch 1759/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6939 - acc: 0.7042 - val_loss: 0.6624 - val_acc: 0.7056
Epoch 1760/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6724 - acc: 0.7153 - val_loss: 0.6614 - val_acc: 0.7056
Epoch 1761/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6661 - acc: 0.7042 - val_loss: 0.6610 - val_acc: 0.7056
Epoch 1762/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6892 - acc: 0.7000 - val_loss: 0.6605 - val_acc: 0.7056
Epoch 1763/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6960 - acc: 0.6903 - val_loss: 0.6596 - val_acc: 0.7056
Epoch 1764/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6677 - acc: 0.7097 - val_loss: 0.6588 - val_acc: 0.7111
Epoch 1765/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6746 - acc: 0.7264 - val_loss: 0.6585 - val_acc: 0.7111
Epoch 1766/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6727 - acc: 0.7097 - val_loss: 0.6584 - val_acc: 0.7111
Epoch 1767/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6906 - acc: 0.7139 - val_loss: 0.6585 - val_acc: 0.7111
Epoch 1768/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6799 - acc: 0.7139 - val_loss: 0.6582 - val_acc: 0.7111
Epoch 1769/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6767 - acc: 0.7056 - val_loss: 0.6583 - val_acc: 0.7056
Epoch 1770/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6658 - acc: 0.7208 - val_loss: 0.6584 - val_acc: 0.7111
Epoch 1771/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6786 - acc: 0.7236 - val_loss: 0.6589 - val_acc: 0.7167
Epoch 1772/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6959 - acc: 0.6875 - val_loss: 0.6594 - val_acc: 0.7222
Epoch 1773/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6846 - acc: 0.6986 - val_loss: 0.6601 - val_acc: 0.7222
Epoch 1774/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6863 - acc: 0.7042 - val_loss: 0.6607 - val_acc: 0.7333
Epoch 1775/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6897 - acc: 0.7000 - val_loss: 0.6610 - val_acc: 0.7278
Epoch 1776/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6643 - acc: 0.7125 - val_loss: 0.6612 - val_acc: 0.7278
Epoch 1777/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6969 - acc: 0.7028 - val_loss: 0.6610 - val_acc: 0.7222
Epoch 1778/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6887 - acc: 0.7222 - val_loss: 0.6606 - val_acc: 0.7111
Epoch 1779/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6814 - acc: 0.7153 - val_loss: 0.6606 - val_acc: 0.7111
Epoch 1780/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6751 - acc: 0.7236 - val_loss: 0.6610 - val_acc: 0.7056
Epoch 1781/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6720 - acc: 0.7139 - val_loss: 0.6622 - val_acc: 0.7056
Epoch 1782/3000
720/720 [==============================] - 0s 40us/step - loss: 0.6825 - acc: 0.7181 - val_loss: 0.6634 - val_acc: 0.7000
Epoch 1783/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6882 - acc: 0.7167 - val_loss: 0.6649 - val_acc: 0.7000
Epoch 1784/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6884 - acc: 0.7028 - val_loss: 0.6670 - val_acc: 0.7000
Epoch 1785/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6772 - acc: 0.7153 - val_loss: 0.6696 - val_acc: 0.7000
Epoch 1786/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6806 - acc: 0.7083 - val_loss: 0.6721 - val_acc: 0.7000
Epoch 1787/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6665 - acc: 0.7028 - val_loss: 0.6751 - val_acc: 0.7056
Epoch 1788/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6781 - acc: 0.7028 - val_loss: 0.6752 - val_acc: 0.7056
Epoch 1789/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7025 - acc: 0.6972 - val_loss: 0.6760 - val_acc: 0.7056
Epoch 1790/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6881 - acc: 0.7083 - val_loss: 0.6763 - val_acc: 0.7056
Epoch 1791/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6916 - acc: 0.6958 - val_loss: 0.6760 - val_acc: 0.7056
Epoch 1792/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6861 - acc: 0.7042 - val_loss: 0.6766 - val_acc: 0.7056
Epoch 1793/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6670 - acc: 0.7208 - val_loss: 0.6761 - val_acc: 0.7056
Epoch 1794/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6857 - acc: 0.6931 - val_loss: 0.6745 - val_acc: 0.7167
Epoch 1795/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6899 - acc: 0.6958 - val_loss: 0.6723 - val_acc: 0.7167
Epoch 1796/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6829 - acc: 0.7125 - val_loss: 0.6711 - val_acc: 0.7167
Epoch 1797/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6931 - acc: 0.7111 - val_loss: 0.6697 - val_acc: 0.7167
Epoch 1798/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6830 - acc: 0.7167 - val_loss: 0.6692 - val_acc: 0.7167
Epoch 1799/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6854 - acc: 0.7000 - val_loss: 0.6688 - val_acc: 0.7167
Epoch 1800/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6798 - acc: 0.6972 - val_loss: 0.6682 - val_acc: 0.7222
Epoch 1801/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6695 - acc: 0.7097 - val_loss: 0.6683 - val_acc: 0.7278
Epoch 1802/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6874 - acc: 0.6889 - val_loss: 0.6683 - val_acc: 0.7278
Epoch 1803/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6711 - acc: 0.7083 - val_loss: 0.6679 - val_acc: 0.7222
Epoch 1804/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6798 - acc: 0.7056 - val_loss: 0.6671 - val_acc: 0.7222
Epoch 1805/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6644 - acc: 0.7056 - val_loss: 0.6662 - val_acc: 0.7278
Epoch 1806/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6873 - acc: 0.7153 - val_loss: 0.6664 - val_acc: 0.7278
Epoch 1807/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6952 - acc: 0.6972 - val_loss: 0.6648 - val_acc: 0.7222
Epoch 1808/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6515 - acc: 0.7194 - val_loss: 0.6622 - val_acc: 0.7278
Epoch 1809/3000
720/720 [==============================] - 0s 29us/step - loss: 0.7041 - acc: 0.6986 - val_loss: 0.6598 - val_acc: 0.7278
Epoch 1810/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6974 - acc: 0.7042 - val_loss: 0.6587 - val_acc: 0.7278
Epoch 1811/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6959 - acc: 0.7111 - val_loss: 0.6581 - val_acc: 0.7278
Epoch 1812/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6935 - acc: 0.6972 - val_loss: 0.6576 - val_acc: 0.7222
Epoch 1813/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6693 - acc: 0.7111 - val_loss: 0.6568 - val_acc: 0.7222
Epoch 1814/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6767 - acc: 0.7125 - val_loss: 0.6566 - val_acc: 0.7222
Epoch 1815/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6634 - acc: 0.7083 - val_loss: 0.6569 - val_acc: 0.7222
Epoch 1816/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6721 - acc: 0.7208 - val_loss: 0.6570 - val_acc: 0.7222
Epoch 1817/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6814 - acc: 0.7014 - val_loss: 0.6581 - val_acc: 0.7222
Epoch 1818/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6786 - acc: 0.7083 - val_loss: 0.6588 - val_acc: 0.7222
Epoch 1819/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6971 - acc: 0.7153 - val_loss: 0.6597 - val_acc: 0.7222
Epoch 1820/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6949 - acc: 0.7056 - val_loss: 0.6604 - val_acc: 0.7222
Epoch 1821/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6958 - acc: 0.7236 - val_loss: 0.6610 - val_acc: 0.7167
Epoch 1822/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7001 - acc: 0.7000 - val_loss: 0.6612 - val_acc: 0.7222
Epoch 1823/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6839 - acc: 0.7125 - val_loss: 0.6621 - val_acc: 0.7222
Epoch 1824/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6743 - acc: 0.7153 - val_loss: 0.6626 - val_acc: 0.7167
Epoch 1825/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6830 - acc: 0.7194 - val_loss: 0.6627 - val_acc: 0.7167
Epoch 1826/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6858 - acc: 0.7014 - val_loss: 0.6629 - val_acc: 0.7167
Epoch 1827/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6837 - acc: 0.7208 - val_loss: 0.6638 - val_acc: 0.7167
Epoch 1828/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6848 - acc: 0.7083 - val_loss: 0.6653 - val_acc: 0.7167
Epoch 1829/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6916 - acc: 0.7014 - val_loss: 0.6671 - val_acc: 0.7167
Epoch 1830/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7013 - acc: 0.7000 - val_loss: 0.6691 - val_acc: 0.7056
Epoch 1831/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6680 - acc: 0.7167 - val_loss: 0.6704 - val_acc: 0.7056
Epoch 1832/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6724 - acc: 0.7042 - val_loss: 0.6706 - val_acc: 0.7056
Epoch 1833/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6687 - acc: 0.7181 - val_loss: 0.6708 - val_acc: 0.7056
Epoch 1834/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6724 - acc: 0.7222 - val_loss: 0.6693 - val_acc: 0.7056
Epoch 1835/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6616 - acc: 0.7208 - val_loss: 0.6680 - val_acc: 0.7111
Epoch 1836/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6636 - acc: 0.7361 - val_loss: 0.6663 - val_acc: 0.7111
Epoch 1837/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6623 - acc: 0.7028 - val_loss: 0.6645 - val_acc: 0.7111
Epoch 1838/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6629 - acc: 0.7014 - val_loss: 0.6627 - val_acc: 0.7167
Epoch 1839/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6711 - acc: 0.6986 - val_loss: 0.6616 - val_acc: 0.7167
Epoch 1840/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6636 - acc: 0.7097 - val_loss: 0.6610 - val_acc: 0.7167
Epoch 1841/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6816 - acc: 0.7125 - val_loss: 0.6606 - val_acc: 0.7167
Epoch 1842/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6592 - acc: 0.7139 - val_loss: 0.6603 - val_acc: 0.7167
Epoch 1843/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6774 - acc: 0.7167 - val_loss: 0.6600 - val_acc: 0.7167
Epoch 1844/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6634 - acc: 0.6958 - val_loss: 0.6593 - val_acc: 0.7167
Epoch 1845/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6706 - acc: 0.7111 - val_loss: 0.6581 - val_acc: 0.7111
Epoch 1846/3000
720/720 [==============================] - 0s 46us/step - loss: 0.6832 - acc: 0.7097 - val_loss: 0.6579 - val_acc: 0.7111
Epoch 1847/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6794 - acc: 0.7111 - val_loss: 0.6576 - val_acc: 0.7111
Epoch 1848/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6913 - acc: 0.7125 - val_loss: 0.6570 - val_acc: 0.7111
Epoch 1849/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6851 - acc: 0.7069 - val_loss: 0.6559 - val_acc: 0.7111
Epoch 1850/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6733 - acc: 0.6958 - val_loss: 0.6553 - val_acc: 0.7111
Epoch 1851/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6812 - acc: 0.7083 - val_loss: 0.6547 - val_acc: 0.7111
Epoch 1852/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6589 - acc: 0.7083 - val_loss: 0.6545 - val_acc: 0.7111
Epoch 1853/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6839 - acc: 0.7139 - val_loss: 0.6543 - val_acc: 0.7111
Epoch 1854/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6833 - acc: 0.7125 - val_loss: 0.6542 - val_acc: 0.7111
Epoch 1855/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6875 - acc: 0.7042 - val_loss: 0.6541 - val_acc: 0.7111
Epoch 1856/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6599 - acc: 0.7097 - val_loss: 0.6537 - val_acc: 0.7111
Epoch 1857/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6810 - acc: 0.7111 - val_loss: 0.6532 - val_acc: 0.7111
Epoch 1858/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6791 - acc: 0.7056 - val_loss: 0.6529 - val_acc: 0.7111
Epoch 1859/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6894 - acc: 0.7083 - val_loss: 0.6522 - val_acc: 0.7111
Epoch 1860/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7086 - acc: 0.7056 - val_loss: 0.6516 - val_acc: 0.7111
Epoch 1861/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6519 - acc: 0.7111 - val_loss: 0.6511 - val_acc: 0.7111
Epoch 1862/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6575 - acc: 0.7194 - val_loss: 0.6503 - val_acc: 0.7167
Epoch 1863/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7002 - acc: 0.6931 - val_loss: 0.6496 - val_acc: 0.7111
Epoch 1864/3000
720/720 [==============================] - 0s 36us/step - loss: 0.6704 - acc: 0.7111 - val_loss: 0.6499 - val_acc: 0.7111
Epoch 1865/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6937 - acc: 0.7014 - val_loss: 0.6504 - val_acc: 0.7111
Epoch 1866/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6726 - acc: 0.7097 - val_loss: 0.6513 - val_acc: 0.7056
Epoch 1867/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6803 - acc: 0.7167 - val_loss: 0.6522 - val_acc: 0.7000
Epoch 1868/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6844 - acc: 0.7181 - val_loss: 0.6530 - val_acc: 0.7000
Epoch 1869/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6869 - acc: 0.7181 - val_loss: 0.6535 - val_acc: 0.7000
Epoch 1870/3000
720/720 [==============================] - 0s 17us/step - loss: 0.7103 - acc: 0.6972 - val_loss: 0.6541 - val_acc: 0.7056
Epoch 1871/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6834 - acc: 0.6986 - val_loss: 0.6548 - val_acc: 0.7056
Epoch 1872/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6916 - acc: 0.7125 - val_loss: 0.6556 - val_acc: 0.7056
Epoch 1873/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6962 - acc: 0.6875 - val_loss: 0.6570 - val_acc: 0.7056
Epoch 1874/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6778 - acc: 0.7125 - val_loss: 0.6590 - val_acc: 0.7000
Epoch 1875/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6801 - acc: 0.7125 - val_loss: 0.6612 - val_acc: 0.7000
Epoch 1876/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6943 - acc: 0.6917 - val_loss: 0.6643 - val_acc: 0.7000
Epoch 1877/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6775 - acc: 0.7264 - val_loss: 0.6673 - val_acc: 0.7000
Epoch 1878/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6864 - acc: 0.7014 - val_loss: 0.6690 - val_acc: 0.7056
Epoch 1879/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6988 - acc: 0.6917 - val_loss: 0.6707 - val_acc: 0.7056
Epoch 1880/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6837 - acc: 0.7014 - val_loss: 0.6720 - val_acc: 0.7056
Epoch 1881/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6776 - acc: 0.7208 - val_loss: 0.6733 - val_acc: 0.7000
Epoch 1882/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6714 - acc: 0.7208 - val_loss: 0.6745 - val_acc: 0.7000
Epoch 1883/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6692 - acc: 0.7139 - val_loss: 0.6754 - val_acc: 0.7000
Epoch 1884/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6892 - acc: 0.7125 - val_loss: 0.6759 - val_acc: 0.7000
Epoch 1885/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6897 - acc: 0.7111 - val_loss: 0.6764 - val_acc: 0.7000
Epoch 1886/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6760 - acc: 0.7042 - val_loss: 0.6765 - val_acc: 0.7000
Epoch 1887/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6746 - acc: 0.7181 - val_loss: 0.6768 - val_acc: 0.7000
Epoch 1888/3000
720/720 [==============================] - 0s 39us/step - loss: 0.6923 - acc: 0.6986 - val_loss: 0.6760 - val_acc: 0.7000
Epoch 1889/3000
720/720 [==============================] - 0s 39us/step - loss: 0.6754 - acc: 0.7083 - val_loss: 0.6746 - val_acc: 0.7000
Epoch 1890/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6702 - acc: 0.7250 - val_loss: 0.6735 - val_acc: 0.7000
Epoch 1891/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6718 - acc: 0.7056 - val_loss: 0.6722 - val_acc: 0.7056
Epoch 1892/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6907 - acc: 0.7125 - val_loss: 0.6709 - val_acc: 0.7111
Epoch 1893/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6777 - acc: 0.7181 - val_loss: 0.6698 - val_acc: 0.7111
Epoch 1894/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6866 - acc: 0.7056 - val_loss: 0.6693 - val_acc: 0.7111
Epoch 1895/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6865 - acc: 0.7111 - val_loss: 0.6689 - val_acc: 0.7167
Epoch 1896/3000
720/720 [==============================] - 0s 26us/step - loss: 0.7063 - acc: 0.7167 - val_loss: 0.6690 - val_acc: 0.7167
Epoch 1897/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6666 - acc: 0.7194 - val_loss: 0.6679 - val_acc: 0.7167
Epoch 1898/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6908 - acc: 0.7014 - val_loss: 0.6676 - val_acc: 0.7222
Epoch 1899/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6774 - acc: 0.7083 - val_loss: 0.6663 - val_acc: 0.7167
Epoch 1900/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6548 - acc: 0.7264 - val_loss: 0.6649 - val_acc: 0.7111
Epoch 1901/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6886 - acc: 0.7111 - val_loss: 0.6643 - val_acc: 0.7111
Epoch 1902/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6953 - acc: 0.7014 - val_loss: 0.6640 - val_acc: 0.7111
Epoch 1903/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6852 - acc: 0.7139 - val_loss: 0.6631 - val_acc: 0.7056
Epoch 1904/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6669 - acc: 0.7000 - val_loss: 0.6625 - val_acc: 0.7056
Epoch 1905/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6812 - acc: 0.7222 - val_loss: 0.6614 - val_acc: 0.7111
Epoch 1906/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6711 - acc: 0.6972 - val_loss: 0.6606 - val_acc: 0.7111
Epoch 1907/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6787 - acc: 0.7153 - val_loss: 0.6599 - val_acc: 0.7111
Epoch 1908/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7057 - acc: 0.6889 - val_loss: 0.6595 - val_acc: 0.7111
Epoch 1909/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6663 - acc: 0.7111 - val_loss: 0.6597 - val_acc: 0.7111
Epoch 1910/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6915 - acc: 0.7222 - val_loss: 0.6599 - val_acc: 0.7111
Epoch 1911/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7018 - acc: 0.7014 - val_loss: 0.6601 - val_acc: 0.7111
Epoch 1912/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6887 - acc: 0.7083 - val_loss: 0.6605 - val_acc: 0.7111
Epoch 1913/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6819 - acc: 0.7153 - val_loss: 0.6610 - val_acc: 0.7056
Epoch 1914/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6824 - acc: 0.7208 - val_loss: 0.6615 - val_acc: 0.7111
Epoch 1915/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6974 - acc: 0.7000 - val_loss: 0.6621 - val_acc: 0.7056
Epoch 1916/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6825 - acc: 0.6986 - val_loss: 0.6628 - val_acc: 0.7111
Epoch 1917/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6744 - acc: 0.7194 - val_loss: 0.6636 - val_acc: 0.7111
Epoch 1918/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6539 - acc: 0.7250 - val_loss: 0.6647 - val_acc: 0.7111
Epoch 1919/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6663 - acc: 0.7083 - val_loss: 0.6648 - val_acc: 0.7167
Epoch 1920/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6613 - acc: 0.7222 - val_loss: 0.6649 - val_acc: 0.7167
Epoch 1921/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6751 - acc: 0.7167 - val_loss: 0.6647 - val_acc: 0.7111
Epoch 1922/3000
720/720 [==============================] - 0s 36us/step - loss: 0.6812 - acc: 0.7083 - val_loss: 0.6642 - val_acc: 0.7167
Epoch 1923/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6873 - acc: 0.7111 - val_loss: 0.6638 - val_acc: 0.7167
Epoch 1924/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6748 - acc: 0.7083 - val_loss: 0.6628 - val_acc: 0.7167
Epoch 1925/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6790 - acc: 0.7042 - val_loss: 0.6618 - val_acc: 0.7167
Epoch 1926/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6668 - acc: 0.7194 - val_loss: 0.6612 - val_acc: 0.7167
Epoch 1927/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6764 - acc: 0.7181 - val_loss: 0.6610 - val_acc: 0.7222
Epoch 1928/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6717 - acc: 0.6972 - val_loss: 0.6613 - val_acc: 0.7222
Epoch 1929/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6965 - acc: 0.7000 - val_loss: 0.6623 - val_acc: 0.7222
Epoch 1930/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6975 - acc: 0.6972 - val_loss: 0.6633 - val_acc: 0.7222
Epoch 1931/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6911 - acc: 0.6958 - val_loss: 0.6639 - val_acc: 0.7222
Epoch 1932/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6880 - acc: 0.6958 - val_loss: 0.6634 - val_acc: 0.7222
Epoch 1933/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6739 - acc: 0.7083 - val_loss: 0.6632 - val_acc: 0.7222
Epoch 1934/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6715 - acc: 0.6944 - val_loss: 0.6627 - val_acc: 0.7222
Epoch 1935/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6840 - acc: 0.6944 - val_loss: 0.6624 - val_acc: 0.7222
Epoch 1936/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6918 - acc: 0.7042 - val_loss: 0.6624 - val_acc: 0.7222
Epoch 1937/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6656 - acc: 0.7111 - val_loss: 0.6621 - val_acc: 0.7278
Epoch 1938/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6841 - acc: 0.7056 - val_loss: 0.6621 - val_acc: 0.7222
Epoch 1939/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6654 - acc: 0.7083 - val_loss: 0.6620 - val_acc: 0.7278
Epoch 1940/3000
720/720 [==============================] - 0s 37us/step - loss: 0.6876 - acc: 0.6917 - val_loss: 0.6620 - val_acc: 0.7278
Epoch 1941/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6738 - acc: 0.7194 - val_loss: 0.6622 - val_acc: 0.7278
Epoch 1942/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6887 - acc: 0.7125 - val_loss: 0.6620 - val_acc: 0.7278
Epoch 1943/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6711 - acc: 0.7083 - val_loss: 0.6618 - val_acc: 0.7333
Epoch 1944/3000
720/720 [==============================] - 0s 22us/step - loss: 0.7009 - acc: 0.6958 - val_loss: 0.6616 - val_acc: 0.7333
Epoch 1945/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6941 - acc: 0.7000 - val_loss: 0.6617 - val_acc: 0.7333
Epoch 1946/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6864 - acc: 0.7028 - val_loss: 0.6619 - val_acc: 0.7333
Epoch 1947/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6669 - acc: 0.7069 - val_loss: 0.6616 - val_acc: 0.7333
Epoch 1948/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6729 - acc: 0.7194 - val_loss: 0.6618 - val_acc: 0.7278
Epoch 1949/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6724 - acc: 0.7139 - val_loss: 0.6619 - val_acc: 0.7333
Epoch 1950/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6653 - acc: 0.6986 - val_loss: 0.6620 - val_acc: 0.7278
Epoch 1951/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6643 - acc: 0.7167 - val_loss: 0.6622 - val_acc: 0.7333
Epoch 1952/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6764 - acc: 0.7056 - val_loss: 0.6625 - val_acc: 0.7278
Epoch 1953/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6573 - acc: 0.7097 - val_loss: 0.6624 - val_acc: 0.7222
Epoch 1954/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6638 - acc: 0.7319 - val_loss: 0.6624 - val_acc: 0.7222
Epoch 1955/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6646 - acc: 0.7208 - val_loss: 0.6623 - val_acc: 0.7167
Epoch 1956/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6843 - acc: 0.7097 - val_loss: 0.6626 - val_acc: 0.7167
Epoch 1957/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6757 - acc: 0.7167 - val_loss: 0.6631 - val_acc: 0.7167
Epoch 1958/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6762 - acc: 0.7042 - val_loss: 0.6639 - val_acc: 0.7167
Epoch 1959/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6925 - acc: 0.7083 - val_loss: 0.6644 - val_acc: 0.7167
Epoch 1960/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6916 - acc: 0.6861 - val_loss: 0.6651 - val_acc: 0.7111
Epoch 1961/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6827 - acc: 0.7042 - val_loss: 0.6652 - val_acc: 0.7167
Epoch 1962/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6590 - acc: 0.7236 - val_loss: 0.6649 - val_acc: 0.7167
Epoch 1963/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6755 - acc: 0.7042 - val_loss: 0.6653 - val_acc: 0.7167
Epoch 1964/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6879 - acc: 0.7014 - val_loss: 0.6658 - val_acc: 0.7167
Epoch 1965/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6885 - acc: 0.7056 - val_loss: 0.6659 - val_acc: 0.7167
Epoch 1966/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6701 - acc: 0.6986 - val_loss: 0.6657 - val_acc: 0.7111
Epoch 1967/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6684 - acc: 0.7042 - val_loss: 0.6653 - val_acc: 0.7111
Epoch 1968/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6680 - acc: 0.7153 - val_loss: 0.6649 - val_acc: 0.7111
Epoch 1969/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6968 - acc: 0.6875 - val_loss: 0.6650 - val_acc: 0.7111
Epoch 1970/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6843 - acc: 0.7028 - val_loss: 0.6655 - val_acc: 0.7111
Epoch 1971/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6753 - acc: 0.7153 - val_loss: 0.6662 - val_acc: 0.7111
Epoch 1972/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6757 - acc: 0.7236 - val_loss: 0.6669 - val_acc: 0.7111
Epoch 1973/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6850 - acc: 0.7111 - val_loss: 0.6673 - val_acc: 0.7111
Epoch 1974/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6680 - acc: 0.7139 - val_loss: 0.6675 - val_acc: 0.7111
Epoch 1975/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6638 - acc: 0.7139 - val_loss: 0.6686 - val_acc: 0.7111
Epoch 1976/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6718 - acc: 0.7083 - val_loss: 0.6702 - val_acc: 0.7111
Epoch 1977/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6549 - acc: 0.7264 - val_loss: 0.6718 - val_acc: 0.7111
Epoch 1978/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6736 - acc: 0.6972 - val_loss: 0.6733 - val_acc: 0.7111
Epoch 1979/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6721 - acc: 0.7028 - val_loss: 0.6747 - val_acc: 0.7111
Epoch 1980/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6696 - acc: 0.7153 - val_loss: 0.6751 - val_acc: 0.7222
Epoch 1981/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6594 - acc: 0.7250 - val_loss: 0.6751 - val_acc: 0.7222
Epoch 1982/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6747 - acc: 0.7069 - val_loss: 0.6732 - val_acc: 0.7167
Epoch 1983/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6768 - acc: 0.7194 - val_loss: 0.6712 - val_acc: 0.7111
Epoch 1984/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6697 - acc: 0.7208 - val_loss: 0.6699 - val_acc: 0.7111
Epoch 1985/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6726 - acc: 0.7181 - val_loss: 0.6686 - val_acc: 0.7111
Epoch 1986/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6748 - acc: 0.7139 - val_loss: 0.6681 - val_acc: 0.7167
Epoch 1987/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6922 - acc: 0.7097 - val_loss: 0.6678 - val_acc: 0.7167
Epoch 1988/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6575 - acc: 0.7264 - val_loss: 0.6673 - val_acc: 0.7167
Epoch 1989/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6617 - acc: 0.7153 - val_loss: 0.6667 - val_acc: 0.7167
Epoch 1990/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6738 - acc: 0.7139 - val_loss: 0.6674 - val_acc: 0.7167
Epoch 1991/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6826 - acc: 0.7097 - val_loss: 0.6675 - val_acc: 0.7222
Epoch 1992/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6829 - acc: 0.7181 - val_loss: 0.6675 - val_acc: 0.7278
Epoch 1993/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6671 - acc: 0.6972 - val_loss: 0.6676 - val_acc: 0.7222
Epoch 1994/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6861 - acc: 0.7153 - val_loss: 0.6671 - val_acc: 0.7222
Epoch 1995/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6709 - acc: 0.7069 - val_loss: 0.6661 - val_acc: 0.7222
Epoch 1996/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6890 - acc: 0.7028 - val_loss: 0.6653 - val_acc: 0.7222
Epoch 1997/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6726 - acc: 0.7056 - val_loss: 0.6649 - val_acc: 0.7222
Epoch 1998/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6808 - acc: 0.7153 - val_loss: 0.6654 - val_acc: 0.7222
Epoch 1999/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6740 - acc: 0.7222 - val_loss: 0.6663 - val_acc: 0.7278
Epoch 2000/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6726 - acc: 0.7139 - val_loss: 0.6675 - val_acc: 0.7278
Epoch 2001/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6830 - acc: 0.6889 - val_loss: 0.6683 - val_acc: 0.7278
Epoch 2002/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6995 - acc: 0.6972 - val_loss: 0.6699 - val_acc: 0.7222
Epoch 2003/3000
720/720 [==============================] - 0s 38us/step - loss: 0.6747 - acc: 0.7028 - val_loss: 0.6713 - val_acc: 0.7222
Epoch 2004/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6632 - acc: 0.7236 - val_loss: 0.6720 - val_acc: 0.7222
Epoch 2005/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6957 - acc: 0.7014 - val_loss: 0.6727 - val_acc: 0.7167
Epoch 2006/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6774 - acc: 0.7028 - val_loss: 0.6744 - val_acc: 0.7222
Epoch 2007/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6671 - acc: 0.7222 - val_loss: 0.6755 - val_acc: 0.7222
Epoch 2008/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6585 - acc: 0.7056 - val_loss: 0.6743 - val_acc: 0.7222
Epoch 2009/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6675 - acc: 0.7111 - val_loss: 0.6736 - val_acc: 0.7167
Epoch 2010/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6769 - acc: 0.7000 - val_loss: 0.6725 - val_acc: 0.7222
Epoch 2011/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6782 - acc: 0.7042 - val_loss: 0.6698 - val_acc: 0.7278
Epoch 2012/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6718 - acc: 0.7125 - val_loss: 0.6678 - val_acc: 0.7278
Epoch 2013/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6781 - acc: 0.7181 - val_loss: 0.6649 - val_acc: 0.7222
Epoch 2014/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6642 - acc: 0.7097 - val_loss: 0.6627 - val_acc: 0.7167
Epoch 2015/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6822 - acc: 0.7042 - val_loss: 0.6609 - val_acc: 0.7167
Epoch 2016/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6858 - acc: 0.7056 - val_loss: 0.6607 - val_acc: 0.7222
Epoch 2017/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6782 - acc: 0.7139 - val_loss: 0.6605 - val_acc: 0.7222
Epoch 2018/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6678 - acc: 0.7139 - val_loss: 0.6600 - val_acc: 0.7222
Epoch 2019/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6724 - acc: 0.7056 - val_loss: 0.6594 - val_acc: 0.7222
Epoch 2020/3000
720/720 [==============================] - 0s 37us/step - loss: 0.6593 - acc: 0.7208 - val_loss: 0.6602 - val_acc: 0.7222
Epoch 2021/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6629 - acc: 0.7097 - val_loss: 0.6606 - val_acc: 0.7222
Epoch 2022/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6747 - acc: 0.7083 - val_loss: 0.6613 - val_acc: 0.7278
Epoch 2023/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6755 - acc: 0.7167 - val_loss: 0.6622 - val_acc: 0.7278
Epoch 2024/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6719 - acc: 0.7083 - val_loss: 0.6634 - val_acc: 0.7222
Epoch 2025/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6703 - acc: 0.7083 - val_loss: 0.6649 - val_acc: 0.7222
Epoch 2026/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6843 - acc: 0.7097 - val_loss: 0.6661 - val_acc: 0.7222
Epoch 2027/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6682 - acc: 0.6972 - val_loss: 0.6669 - val_acc: 0.7167
Epoch 2028/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6840 - acc: 0.7222 - val_loss: 0.6675 - val_acc: 0.7222
Epoch 2029/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6913 - acc: 0.7028 - val_loss: 0.6685 - val_acc: 0.7222
Epoch 2030/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6652 - acc: 0.7069 - val_loss: 0.6694 - val_acc: 0.7222
Epoch 2031/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6701 - acc: 0.7097 - val_loss: 0.6704 - val_acc: 0.7222
Epoch 2032/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6874 - acc: 0.7125 - val_loss: 0.6712 - val_acc: 0.7222
Epoch 2033/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6621 - acc: 0.7264 - val_loss: 0.6723 - val_acc: 0.7222
Epoch 2034/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6681 - acc: 0.7097 - val_loss: 0.6726 - val_acc: 0.7222
Epoch 2035/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6771 - acc: 0.7056 - val_loss: 0.6725 - val_acc: 0.7222
Epoch 2036/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6805 - acc: 0.7042 - val_loss: 0.6725 - val_acc: 0.7222
Epoch 2037/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6897 - acc: 0.7125 - val_loss: 0.6719 - val_acc: 0.7222
Epoch 2038/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6693 - acc: 0.7167 - val_loss: 0.6702 - val_acc: 0.7222
Epoch 2039/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6598 - acc: 0.7125 - val_loss: 0.6686 - val_acc: 0.7222
Epoch 2040/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6639 - acc: 0.7111 - val_loss: 0.6664 - val_acc: 0.7222
Epoch 2041/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6678 - acc: 0.7347 - val_loss: 0.6648 - val_acc: 0.7222
Epoch 2042/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6794 - acc: 0.7139 - val_loss: 0.6628 - val_acc: 0.7278
Epoch 2043/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6745 - acc: 0.7139 - val_loss: 0.6606 - val_acc: 0.7222
Epoch 2044/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6717 - acc: 0.7153 - val_loss: 0.6579 - val_acc: 0.7222
Epoch 2045/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6796 - acc: 0.7236 - val_loss: 0.6555 - val_acc: 0.7333
Epoch 2046/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6995 - acc: 0.6986 - val_loss: 0.6539 - val_acc: 0.7278
Epoch 2047/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6892 - acc: 0.7083 - val_loss: 0.6523 - val_acc: 0.7278
Epoch 2048/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6770 - acc: 0.7028 - val_loss: 0.6512 - val_acc: 0.7278
Epoch 2049/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6904 - acc: 0.7153 - val_loss: 0.6501 - val_acc: 0.7222
Epoch 2050/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6980 - acc: 0.7125 - val_loss: 0.6491 - val_acc: 0.7222
Epoch 2051/3000
720/720 [==============================] - 0s 39us/step - loss: 0.6738 - acc: 0.7222 - val_loss: 0.6484 - val_acc: 0.7222
Epoch 2052/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6741 - acc: 0.7056 - val_loss: 0.6477 - val_acc: 0.7222
Epoch 2053/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6820 - acc: 0.6972 - val_loss: 0.6471 - val_acc: 0.7222
Epoch 2054/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6997 - acc: 0.6917 - val_loss: 0.6471 - val_acc: 0.7222
Epoch 2055/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6620 - acc: 0.7194 - val_loss: 0.6468 - val_acc: 0.7222
Epoch 2056/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6903 - acc: 0.6792 - val_loss: 0.6472 - val_acc: 0.7222
Epoch 2057/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6662 - acc: 0.7167 - val_loss: 0.6480 - val_acc: 0.7222
Epoch 2058/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6657 - acc: 0.7083 - val_loss: 0.6487 - val_acc: 0.7222
Epoch 2059/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6659 - acc: 0.7042 - val_loss: 0.6497 - val_acc: 0.7222
Epoch 2060/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6519 - acc: 0.7278 - val_loss: 0.6507 - val_acc: 0.7222
Epoch 2061/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6908 - acc: 0.7097 - val_loss: 0.6516 - val_acc: 0.7222
Epoch 2062/3000
720/720 [==============================] - 0s 42us/step - loss: 0.6592 - acc: 0.7278 - val_loss: 0.6528 - val_acc: 0.7167
Epoch 2063/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6706 - acc: 0.7139 - val_loss: 0.6537 - val_acc: 0.7111
Epoch 2064/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6770 - acc: 0.7111 - val_loss: 0.6538 - val_acc: 0.7111
Epoch 2065/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6893 - acc: 0.7111 - val_loss: 0.6541 - val_acc: 0.7111
Epoch 2066/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6557 - acc: 0.7028 - val_loss: 0.6549 - val_acc: 0.7111
Epoch 2067/3000
720/720 [==============================] - 0s 51us/step - loss: 0.6739 - acc: 0.7222 - val_loss: 0.6559 - val_acc: 0.7111
Epoch 2068/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6957 - acc: 0.7028 - val_loss: 0.6560 - val_acc: 0.7111
Epoch 2069/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6505 - acc: 0.7236 - val_loss: 0.6561 - val_acc: 0.7111
Epoch 2070/3000
720/720 [==============================] - 0s 53us/step - loss: 0.6772 - acc: 0.7069 - val_loss: 0.6563 - val_acc: 0.7111
Epoch 2071/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6705 - acc: 0.7194 - val_loss: 0.6567 - val_acc: 0.7111
Epoch 2072/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6776 - acc: 0.7069 - val_loss: 0.6572 - val_acc: 0.7111
Epoch 2073/3000
720/720 [==============================] - 0s 47us/step - loss: 0.6647 - acc: 0.6972 - val_loss: 0.6577 - val_acc: 0.7111
Epoch 2074/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6729 - acc: 0.7208 - val_loss: 0.6580 - val_acc: 0.7111
Epoch 2075/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6739 - acc: 0.7111 - val_loss: 0.6580 - val_acc: 0.7111
Epoch 2076/3000
720/720 [==============================] - 0s 39us/step - loss: 0.6724 - acc: 0.7014 - val_loss: 0.6576 - val_acc: 0.7111
Epoch 2077/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6971 - acc: 0.7069 - val_loss: 0.6574 - val_acc: 0.7111
Epoch 2078/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6745 - acc: 0.7014 - val_loss: 0.6568 - val_acc: 0.7111
Epoch 2079/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6867 - acc: 0.7125 - val_loss: 0.6566 - val_acc: 0.7167
Epoch 2080/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6982 - acc: 0.6917 - val_loss: 0.6569 - val_acc: 0.7222
Epoch 2081/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6716 - acc: 0.7208 - val_loss: 0.6568 - val_acc: 0.7278
Epoch 2082/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6874 - acc: 0.6972 - val_loss: 0.6571 - val_acc: 0.7222
Epoch 2083/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6526 - acc: 0.7250 - val_loss: 0.6577 - val_acc: 0.7167
Epoch 2084/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6763 - acc: 0.6958 - val_loss: 0.6585 - val_acc: 0.7167
Epoch 2085/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6687 - acc: 0.7181 - val_loss: 0.6592 - val_acc: 0.7167
Epoch 2086/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6838 - acc: 0.7208 - val_loss: 0.6598 - val_acc: 0.7167
Epoch 2087/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6630 - acc: 0.7208 - val_loss: 0.6606 - val_acc: 0.7167
Epoch 2088/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6655 - acc: 0.7083 - val_loss: 0.6618 - val_acc: 0.7167
Epoch 2089/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6563 - acc: 0.7208 - val_loss: 0.6632 - val_acc: 0.7167
Epoch 2090/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6611 - acc: 0.7306 - val_loss: 0.6642 - val_acc: 0.7167
Epoch 2091/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6791 - acc: 0.7111 - val_loss: 0.6661 - val_acc: 0.7222
Epoch 2092/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6763 - acc: 0.7111 - val_loss: 0.6684 - val_acc: 0.7222
Epoch 2093/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6715 - acc: 0.7292 - val_loss: 0.6697 - val_acc: 0.7222
Epoch 2094/3000
720/720 [==============================] - 0s 37us/step - loss: 0.6833 - acc: 0.7028 - val_loss: 0.6708 - val_acc: 0.7167
Epoch 2095/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6665 - acc: 0.7153 - val_loss: 0.6723 - val_acc: 0.7222
Epoch 2096/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6903 - acc: 0.7056 - val_loss: 0.6741 - val_acc: 0.7222
Epoch 2097/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6824 - acc: 0.7292 - val_loss: 0.6753 - val_acc: 0.7167
Epoch 2098/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6912 - acc: 0.6972 - val_loss: 0.6757 - val_acc: 0.7222
Epoch 2099/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6916 - acc: 0.7028 - val_loss: 0.6757 - val_acc: 0.7222
Epoch 2100/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6599 - acc: 0.7250 - val_loss: 0.6750 - val_acc: 0.7222
Epoch 2101/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6646 - acc: 0.7167 - val_loss: 0.6735 - val_acc: 0.7222
Epoch 2102/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6819 - acc: 0.7042 - val_loss: 0.6726 - val_acc: 0.7222
Epoch 2103/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6549 - acc: 0.7361 - val_loss: 0.6719 - val_acc: 0.7167
Epoch 2104/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6855 - acc: 0.7167 - val_loss: 0.6709 - val_acc: 0.7222
Epoch 2105/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6642 - acc: 0.7222 - val_loss: 0.6705 - val_acc: 0.7222
Epoch 2106/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6654 - acc: 0.7028 - val_loss: 0.6699 - val_acc: 0.7222
Epoch 2107/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6655 - acc: 0.7167 - val_loss: 0.6698 - val_acc: 0.7222
Epoch 2108/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6680 - acc: 0.7014 - val_loss: 0.6697 - val_acc: 0.7278
Epoch 2109/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6406 - acc: 0.7292 - val_loss: 0.6700 - val_acc: 0.7278
Epoch 2110/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6713 - acc: 0.7097 - val_loss: 0.6708 - val_acc: 0.7222
Epoch 2111/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6774 - acc: 0.7097 - val_loss: 0.6715 - val_acc: 0.7167
Epoch 2112/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6859 - acc: 0.7042 - val_loss: 0.6712 - val_acc: 0.7167
Epoch 2113/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6822 - acc: 0.7153 - val_loss: 0.6711 - val_acc: 0.7167
Epoch 2114/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6760 - acc: 0.7278 - val_loss: 0.6719 - val_acc: 0.7167
Epoch 2115/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6754 - acc: 0.7181 - val_loss: 0.6724 - val_acc: 0.7167
Epoch 2116/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6524 - acc: 0.7222 - val_loss: 0.6719 - val_acc: 0.7167
Epoch 2117/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6563 - acc: 0.7125 - val_loss: 0.6714 - val_acc: 0.7167
Epoch 2118/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6731 - acc: 0.7167 - val_loss: 0.6711 - val_acc: 0.7167
Epoch 2119/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6609 - acc: 0.7153 - val_loss: 0.6704 - val_acc: 0.7167
Epoch 2120/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6526 - acc: 0.7208 - val_loss: 0.6692 - val_acc: 0.7167
Epoch 2121/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6770 - acc: 0.7194 - val_loss: 0.6676 - val_acc: 0.7167
Epoch 2122/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6761 - acc: 0.7125 - val_loss: 0.6659 - val_acc: 0.7167
Epoch 2123/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6677 - acc: 0.7153 - val_loss: 0.6634 - val_acc: 0.7167
Epoch 2124/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6647 - acc: 0.7125 - val_loss: 0.6606 - val_acc: 0.7167
Epoch 2125/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6926 - acc: 0.6889 - val_loss: 0.6583 - val_acc: 0.7167
Epoch 2126/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6653 - acc: 0.7097 - val_loss: 0.6553 - val_acc: 0.7111
Epoch 2127/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6691 - acc: 0.7097 - val_loss: 0.6524 - val_acc: 0.7111
Epoch 2128/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6669 - acc: 0.7097 - val_loss: 0.6510 - val_acc: 0.7111
Epoch 2129/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6837 - acc: 0.7097 - val_loss: 0.6498 - val_acc: 0.7167
Epoch 2130/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6632 - acc: 0.7097 - val_loss: 0.6493 - val_acc: 0.7111
Epoch 2131/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6909 - acc: 0.7028 - val_loss: 0.6497 - val_acc: 0.7167
Epoch 2132/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6854 - acc: 0.7097 - val_loss: 0.6505 - val_acc: 0.7167
Epoch 2133/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6688 - acc: 0.7222 - val_loss: 0.6511 - val_acc: 0.7167
Epoch 2134/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6516 - acc: 0.7042 - val_loss: 0.6522 - val_acc: 0.7167
Epoch 2135/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6828 - acc: 0.6972 - val_loss: 0.6539 - val_acc: 0.7167
Epoch 2136/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6731 - acc: 0.7000 - val_loss: 0.6554 - val_acc: 0.7167
Epoch 2137/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6579 - acc: 0.7236 - val_loss: 0.6569 - val_acc: 0.7111
Epoch 2138/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6945 - acc: 0.7194 - val_loss: 0.6586 - val_acc: 0.7111
Epoch 2139/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6664 - acc: 0.7278 - val_loss: 0.6602 - val_acc: 0.7056
Epoch 2140/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6640 - acc: 0.7097 - val_loss: 0.6618 - val_acc: 0.7111
Epoch 2141/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6609 - acc: 0.7056 - val_loss: 0.6633 - val_acc: 0.7111
Epoch 2142/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6689 - acc: 0.7097 - val_loss: 0.6650 - val_acc: 0.7111
Epoch 2143/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6782 - acc: 0.7167 - val_loss: 0.6672 - val_acc: 0.7111
Epoch 2144/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6772 - acc: 0.7250 - val_loss: 0.6695 - val_acc: 0.7111
Epoch 2145/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6854 - acc: 0.7139 - val_loss: 0.6718 - val_acc: 0.7111
Epoch 2146/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6714 - acc: 0.7319 - val_loss: 0.6733 - val_acc: 0.7111
Epoch 2147/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6862 - acc: 0.7167 - val_loss: 0.6751 - val_acc: 0.7111
Epoch 2148/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6793 - acc: 0.7194 - val_loss: 0.6762 - val_acc: 0.7111
Epoch 2149/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6923 - acc: 0.7056 - val_loss: 0.6778 - val_acc: 0.7111
Epoch 2150/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6611 - acc: 0.6958 - val_loss: 0.6798 - val_acc: 0.7111
Epoch 2151/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6772 - acc: 0.7208 - val_loss: 0.6819 - val_acc: 0.7111
Epoch 2152/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6714 - acc: 0.7069 - val_loss: 0.6832 - val_acc: 0.7056
Epoch 2153/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6552 - acc: 0.7236 - val_loss: 0.6835 - val_acc: 0.7056
Epoch 2154/3000
720/720 [==============================] - 0s 39us/step - loss: 0.6831 - acc: 0.7042 - val_loss: 0.6835 - val_acc: 0.7056
Epoch 2155/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6392 - acc: 0.7181 - val_loss: 0.6839 - val_acc: 0.7056
Epoch 2156/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6632 - acc: 0.7361 - val_loss: 0.6847 - val_acc: 0.7111
Epoch 2157/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6794 - acc: 0.7125 - val_loss: 0.6845 - val_acc: 0.7111
Epoch 2158/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6740 - acc: 0.7222 - val_loss: 0.6836 - val_acc: 0.7111
Epoch 2159/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6875 - acc: 0.6958 - val_loss: 0.6826 - val_acc: 0.7111
Epoch 2160/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6693 - acc: 0.7153 - val_loss: 0.6820 - val_acc: 0.7111
Epoch 2161/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6631 - acc: 0.7181 - val_loss: 0.6801 - val_acc: 0.7056
Epoch 2162/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6865 - acc: 0.7083 - val_loss: 0.6784 - val_acc: 0.7111
Epoch 2163/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6670 - acc: 0.7111 - val_loss: 0.6776 - val_acc: 0.7111
Epoch 2164/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6660 - acc: 0.7069 - val_loss: 0.6771 - val_acc: 0.7111
Epoch 2165/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6853 - acc: 0.7083 - val_loss: 0.6762 - val_acc: 0.7111
Epoch 2166/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6755 - acc: 0.7125 - val_loss: 0.6757 - val_acc: 0.7111
Epoch 2167/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6565 - acc: 0.7222 - val_loss: 0.6747 - val_acc: 0.7167
Epoch 2168/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6681 - acc: 0.7181 - val_loss: 0.6736 - val_acc: 0.7222
Epoch 2169/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6734 - acc: 0.7111 - val_loss: 0.6727 - val_acc: 0.7333
Epoch 2170/3000
720/720 [==============================] - 0s 36us/step - loss: 0.6839 - acc: 0.7264 - val_loss: 0.6721 - val_acc: 0.7333
Epoch 2171/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6733 - acc: 0.7139 - val_loss: 0.6718 - val_acc: 0.7333
Epoch 2172/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6495 - acc: 0.7097 - val_loss: 0.6719 - val_acc: 0.7333
Epoch 2173/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6596 - acc: 0.7097 - val_loss: 0.6720 - val_acc: 0.7333
Epoch 2174/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6729 - acc: 0.7167 - val_loss: 0.6725 - val_acc: 0.7333
Epoch 2175/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6680 - acc: 0.7069 - val_loss: 0.6729 - val_acc: 0.7333
Epoch 2176/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6652 - acc: 0.7194 - val_loss: 0.6739 - val_acc: 0.7333
Epoch 2177/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6777 - acc: 0.7208 - val_loss: 0.6733 - val_acc: 0.7333
Epoch 2178/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6442 - acc: 0.7153 - val_loss: 0.6726 - val_acc: 0.7333
Epoch 2179/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6778 - acc: 0.6986 - val_loss: 0.6715 - val_acc: 0.7333
Epoch 2180/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6722 - acc: 0.6944 - val_loss: 0.6706 - val_acc: 0.7333
Epoch 2181/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6470 - acc: 0.7167 - val_loss: 0.6700 - val_acc: 0.7333
Epoch 2182/3000
720/720 [==============================] - 0s 15us/step - loss: 0.7048 - acc: 0.6833 - val_loss: 0.6697 - val_acc: 0.7333
Epoch 2183/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6399 - acc: 0.7292 - val_loss: 0.6689 - val_acc: 0.7333
Epoch 2184/3000
720/720 [==============================] - 0s 39us/step - loss: 0.6690 - acc: 0.7111 - val_loss: 0.6680 - val_acc: 0.7333
Epoch 2185/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6989 - acc: 0.7069 - val_loss: 0.6667 - val_acc: 0.7222
Epoch 2186/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6761 - acc: 0.7028 - val_loss: 0.6651 - val_acc: 0.7222
Epoch 2187/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6790 - acc: 0.7097 - val_loss: 0.6640 - val_acc: 0.7222
Epoch 2188/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6508 - acc: 0.7236 - val_loss: 0.6632 - val_acc: 0.7167
Epoch 2189/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6931 - acc: 0.7069 - val_loss: 0.6625 - val_acc: 0.7167
Epoch 2190/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6504 - acc: 0.7250 - val_loss: 0.6617 - val_acc: 0.7167
Epoch 2191/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6497 - acc: 0.7250 - val_loss: 0.6612 - val_acc: 0.7167
Epoch 2192/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6703 - acc: 0.7069 - val_loss: 0.6605 - val_acc: 0.7111
Epoch 2193/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6556 - acc: 0.7264 - val_loss: 0.6600 - val_acc: 0.7056
Epoch 2194/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6620 - acc: 0.7208 - val_loss: 0.6596 - val_acc: 0.7056
Epoch 2195/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6823 - acc: 0.7139 - val_loss: 0.6591 - val_acc: 0.7056
Epoch 2196/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6824 - acc: 0.7097 - val_loss: 0.6586 - val_acc: 0.7000
Epoch 2197/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6775 - acc: 0.7264 - val_loss: 0.6580 - val_acc: 0.7056
Epoch 2198/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6614 - acc: 0.7153 - val_loss: 0.6575 - val_acc: 0.7111
Epoch 2199/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6626 - acc: 0.7069 - val_loss: 0.6568 - val_acc: 0.7167
Epoch 2200/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6495 - acc: 0.7139 - val_loss: 0.6560 - val_acc: 0.7111
Epoch 2201/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6491 - acc: 0.7264 - val_loss: 0.6556 - val_acc: 0.7056
Epoch 2202/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6731 - acc: 0.7097 - val_loss: 0.6561 - val_acc: 0.7056
Epoch 2203/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6731 - acc: 0.7083 - val_loss: 0.6565 - val_acc: 0.7111
Epoch 2204/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6629 - acc: 0.7083 - val_loss: 0.6575 - val_acc: 0.7111
Epoch 2205/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6665 - acc: 0.6986 - val_loss: 0.6582 - val_acc: 0.7111
Epoch 2206/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6760 - acc: 0.7167 - val_loss: 0.6583 - val_acc: 0.7111
Epoch 2207/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6748 - acc: 0.7056 - val_loss: 0.6586 - val_acc: 0.7111
Epoch 2208/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6631 - acc: 0.7181 - val_loss: 0.6589 - val_acc: 0.7111
Epoch 2209/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6829 - acc: 0.7069 - val_loss: 0.6599 - val_acc: 0.7111
Epoch 2210/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6454 - acc: 0.7194 - val_loss: 0.6613 - val_acc: 0.7111
Epoch 2211/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6836 - acc: 0.7028 - val_loss: 0.6617 - val_acc: 0.7111
Epoch 2212/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6758 - acc: 0.7292 - val_loss: 0.6619 - val_acc: 0.7056
Epoch 2213/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6759 - acc: 0.7139 - val_loss: 0.6633 - val_acc: 0.7111
Epoch 2214/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6732 - acc: 0.7069 - val_loss: 0.6646 - val_acc: 0.7111
Epoch 2215/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6665 - acc: 0.7250 - val_loss: 0.6646 - val_acc: 0.7111
Epoch 2216/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6705 - acc: 0.7125 - val_loss: 0.6654 - val_acc: 0.7056
Epoch 2217/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6886 - acc: 0.7028 - val_loss: 0.6670 - val_acc: 0.7056
Epoch 2218/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6687 - acc: 0.7153 - val_loss: 0.6687 - val_acc: 0.7056
Epoch 2219/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6605 - acc: 0.7222 - val_loss: 0.6699 - val_acc: 0.7056
Epoch 2220/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6569 - acc: 0.7042 - val_loss: 0.6721 - val_acc: 0.7056
Epoch 2221/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6723 - acc: 0.7028 - val_loss: 0.6722 - val_acc: 0.7111
Epoch 2222/3000
720/720 [==============================] - 0s 14us/step - loss: 0.7099 - acc: 0.6889 - val_loss: 0.6731 - val_acc: 0.7111
Epoch 2223/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6836 - acc: 0.7014 - val_loss: 0.6731 - val_acc: 0.7167
Epoch 2224/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6951 - acc: 0.7000 - val_loss: 0.6727 - val_acc: 0.7167
Epoch 2225/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6632 - acc: 0.7083 - val_loss: 0.6723 - val_acc: 0.7167
Epoch 2226/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6841 - acc: 0.7000 - val_loss: 0.6710 - val_acc: 0.7167
Epoch 2227/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6568 - acc: 0.7139 - val_loss: 0.6697 - val_acc: 0.7167
Epoch 2228/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6768 - acc: 0.7222 - val_loss: 0.6685 - val_acc: 0.7167
Epoch 2229/3000
720/720 [==============================] - 0s 28us/step - loss: 0.7046 - acc: 0.7083 - val_loss: 0.6679 - val_acc: 0.7167
Epoch 2230/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6807 - acc: 0.7125 - val_loss: 0.6676 - val_acc: 0.7222
Epoch 2231/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6408 - acc: 0.7264 - val_loss: 0.6671 - val_acc: 0.7222
Epoch 2232/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6718 - acc: 0.7333 - val_loss: 0.6671 - val_acc: 0.7222
Epoch 2233/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6514 - acc: 0.7097 - val_loss: 0.6678 - val_acc: 0.7222
Epoch 2234/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6809 - acc: 0.7097 - val_loss: 0.6681 - val_acc: 0.7222
Epoch 2235/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6520 - acc: 0.7250 - val_loss: 0.6681 - val_acc: 0.7222
Epoch 2236/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6611 - acc: 0.7181 - val_loss: 0.6685 - val_acc: 0.7167
Epoch 2237/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6711 - acc: 0.7153 - val_loss: 0.6692 - val_acc: 0.7111
Epoch 2238/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6717 - acc: 0.7236 - val_loss: 0.6694 - val_acc: 0.7111
Epoch 2239/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6780 - acc: 0.7194 - val_loss: 0.6692 - val_acc: 0.7167
Epoch 2240/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6813 - acc: 0.7236 - val_loss: 0.6697 - val_acc: 0.7111
Epoch 2241/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6682 - acc: 0.7153 - val_loss: 0.6702 - val_acc: 0.7111
Epoch 2242/3000
720/720 [==============================] - 0s 51us/step - loss: 0.6346 - acc: 0.7264 - val_loss: 0.6704 - val_acc: 0.7111
Epoch 2243/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6650 - acc: 0.7194 - val_loss: 0.6712 - val_acc: 0.7111
Epoch 2244/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6682 - acc: 0.7236 - val_loss: 0.6718 - val_acc: 0.7111
Epoch 2245/3000
720/720 [==============================] - 0s 49us/step - loss: 0.6792 - acc: 0.7097 - val_loss: 0.6722 - val_acc: 0.7000
Epoch 2246/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6707 - acc: 0.7111 - val_loss: 0.6720 - val_acc: 0.7000
Epoch 2247/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6614 - acc: 0.7125 - val_loss: 0.6718 - val_acc: 0.7056
Epoch 2248/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6745 - acc: 0.7153 - val_loss: 0.6721 - val_acc: 0.7111
Epoch 2249/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6779 - acc: 0.7069 - val_loss: 0.6727 - val_acc: 0.7111
Epoch 2250/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6684 - acc: 0.7153 - val_loss: 0.6737 - val_acc: 0.7111
Epoch 2251/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6753 - acc: 0.7153 - val_loss: 0.6737 - val_acc: 0.7111
Epoch 2252/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6718 - acc: 0.7153 - val_loss: 0.6733 - val_acc: 0.7111
Epoch 2253/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6581 - acc: 0.7111 - val_loss: 0.6732 - val_acc: 0.7167
Epoch 2254/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6585 - acc: 0.7097 - val_loss: 0.6730 - val_acc: 0.7167
Epoch 2255/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6949 - acc: 0.7014 - val_loss: 0.6730 - val_acc: 0.7167
Epoch 2256/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6602 - acc: 0.7139 - val_loss: 0.6732 - val_acc: 0.7167
Epoch 2257/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6524 - acc: 0.7292 - val_loss: 0.6738 - val_acc: 0.7167
Epoch 2258/3000
720/720 [==============================] - 0s 43us/step - loss: 0.6602 - acc: 0.7139 - val_loss: 0.6739 - val_acc: 0.7167
Epoch 2259/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6796 - acc: 0.7222 - val_loss: 0.6738 - val_acc: 0.7167
Epoch 2260/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6565 - acc: 0.7278 - val_loss: 0.6743 - val_acc: 0.7167
Epoch 2261/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6771 - acc: 0.7069 - val_loss: 0.6746 - val_acc: 0.7167
Epoch 2262/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6943 - acc: 0.7014 - val_loss: 0.6745 - val_acc: 0.7167
Epoch 2263/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6655 - acc: 0.7181 - val_loss: 0.6737 - val_acc: 0.7167
Epoch 2264/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6672 - acc: 0.7278 - val_loss: 0.6727 - val_acc: 0.7222
Epoch 2265/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6630 - acc: 0.7292 - val_loss: 0.6718 - val_acc: 0.7278
Epoch 2266/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6713 - acc: 0.7208 - val_loss: 0.6713 - val_acc: 0.7278
Epoch 2267/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6617 - acc: 0.7083 - val_loss: 0.6708 - val_acc: 0.7278
Epoch 2268/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6503 - acc: 0.7347 - val_loss: 0.6701 - val_acc: 0.7333
Epoch 2269/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6719 - acc: 0.7153 - val_loss: 0.6696 - val_acc: 0.7333
Epoch 2270/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6955 - acc: 0.7153 - val_loss: 0.6694 - val_acc: 0.7389
Epoch 2271/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6750 - acc: 0.7208 - val_loss: 0.6693 - val_acc: 0.7389
Epoch 2272/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6946 - acc: 0.7125 - val_loss: 0.6685 - val_acc: 0.7333
Epoch 2273/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6616 - acc: 0.7014 - val_loss: 0.6687 - val_acc: 0.7333
Epoch 2274/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6780 - acc: 0.7139 - val_loss: 0.6677 - val_acc: 0.7278
Epoch 2275/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6723 - acc: 0.7347 - val_loss: 0.6677 - val_acc: 0.7278
Epoch 2276/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6651 - acc: 0.7278 - val_loss: 0.6676 - val_acc: 0.7333
Epoch 2277/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6710 - acc: 0.7125 - val_loss: 0.6677 - val_acc: 0.7278
Epoch 2278/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6662 - acc: 0.7014 - val_loss: 0.6677 - val_acc: 0.7278
Epoch 2279/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6529 - acc: 0.7208 - val_loss: 0.6678 - val_acc: 0.7278
Epoch 2280/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6882 - acc: 0.6944 - val_loss: 0.6684 - val_acc: 0.7278
Epoch 2281/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6595 - acc: 0.7264 - val_loss: 0.6689 - val_acc: 0.7278
Epoch 2282/3000
720/720 [==============================] - 0s 39us/step - loss: 0.6654 - acc: 0.7125 - val_loss: 0.6700 - val_acc: 0.7278
Epoch 2283/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6543 - acc: 0.7097 - val_loss: 0.6718 - val_acc: 0.7278
Epoch 2284/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6758 - acc: 0.7167 - val_loss: 0.6744 - val_acc: 0.7222
Epoch 2285/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6545 - acc: 0.7069 - val_loss: 0.6769 - val_acc: 0.7278
Epoch 2286/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6959 - acc: 0.7278 - val_loss: 0.6786 - val_acc: 0.7278
Epoch 2287/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6697 - acc: 0.7181 - val_loss: 0.6800 - val_acc: 0.7278
Epoch 2288/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6906 - acc: 0.7028 - val_loss: 0.6810 - val_acc: 0.7278
Epoch 2289/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6521 - acc: 0.7292 - val_loss: 0.6823 - val_acc: 0.7278
Epoch 2290/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6841 - acc: 0.7069 - val_loss: 0.6831 - val_acc: 0.7278
Epoch 2291/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6706 - acc: 0.7042 - val_loss: 0.6827 - val_acc: 0.7278
Epoch 2292/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6636 - acc: 0.7181 - val_loss: 0.6821 - val_acc: 0.7278
Epoch 2293/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6732 - acc: 0.7069 - val_loss: 0.6813 - val_acc: 0.7278
Epoch 2294/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6577 - acc: 0.7153 - val_loss: 0.6804 - val_acc: 0.7333
Epoch 2295/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6530 - acc: 0.7181 - val_loss: 0.6793 - val_acc: 0.7333
Epoch 2296/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6813 - acc: 0.7069 - val_loss: 0.6780 - val_acc: 0.7333
Epoch 2297/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6743 - acc: 0.7069 - val_loss: 0.6769 - val_acc: 0.7333
Epoch 2298/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6757 - acc: 0.7125 - val_loss: 0.6760 - val_acc: 0.7278
Epoch 2299/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6866 - acc: 0.7056 - val_loss: 0.6751 - val_acc: 0.7278
Epoch 2300/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6777 - acc: 0.7069 - val_loss: 0.6739 - val_acc: 0.7278
Epoch 2301/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6908 - acc: 0.6972 - val_loss: 0.6728 - val_acc: 0.7167
Epoch 2302/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6652 - acc: 0.7139 - val_loss: 0.6715 - val_acc: 0.7167
Epoch 2303/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6704 - acc: 0.7264 - val_loss: 0.6697 - val_acc: 0.7111
Epoch 2304/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6750 - acc: 0.7083 - val_loss: 0.6675 - val_acc: 0.7111
Epoch 2305/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6813 - acc: 0.7181 - val_loss: 0.6659 - val_acc: 0.7167
Epoch 2306/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6725 - acc: 0.7111 - val_loss: 0.6643 - val_acc: 0.7167
Epoch 2307/3000
720/720 [==============================] - 0s 38us/step - loss: 0.6609 - acc: 0.7056 - val_loss: 0.6620 - val_acc: 0.7167
Epoch 2308/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6694 - acc: 0.7097 - val_loss: 0.6597 - val_acc: 0.7167
Epoch 2309/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6634 - acc: 0.7111 - val_loss: 0.6575 - val_acc: 0.7167
Epoch 2310/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6559 - acc: 0.7222 - val_loss: 0.6558 - val_acc: 0.7167
Epoch 2311/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6661 - acc: 0.7028 - val_loss: 0.6551 - val_acc: 0.7167
Epoch 2312/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6626 - acc: 0.7139 - val_loss: 0.6546 - val_acc: 0.7278
Epoch 2313/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6629 - acc: 0.7153 - val_loss: 0.6542 - val_acc: 0.7278
Epoch 2314/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6579 - acc: 0.7222 - val_loss: 0.6539 - val_acc: 0.7278
Epoch 2315/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6883 - acc: 0.7069 - val_loss: 0.6532 - val_acc: 0.7333
Epoch 2316/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6854 - acc: 0.7056 - val_loss: 0.6528 - val_acc: 0.7333
Epoch 2317/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6698 - acc: 0.7069 - val_loss: 0.6529 - val_acc: 0.7333
Epoch 2318/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6657 - acc: 0.7139 - val_loss: 0.6532 - val_acc: 0.7333
Epoch 2319/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6732 - acc: 0.7194 - val_loss: 0.6539 - val_acc: 0.7278
Epoch 2320/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6639 - acc: 0.7222 - val_loss: 0.6549 - val_acc: 0.7278
Epoch 2321/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6750 - acc: 0.7111 - val_loss: 0.6562 - val_acc: 0.7278
Epoch 2322/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6695 - acc: 0.7069 - val_loss: 0.6580 - val_acc: 0.7222
Epoch 2323/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6624 - acc: 0.7208 - val_loss: 0.6598 - val_acc: 0.7222
Epoch 2324/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6715 - acc: 0.7153 - val_loss: 0.6611 - val_acc: 0.7222
Epoch 2325/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6676 - acc: 0.7264 - val_loss: 0.6625 - val_acc: 0.7333
Epoch 2326/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6752 - acc: 0.7042 - val_loss: 0.6641 - val_acc: 0.7278
Epoch 2327/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6656 - acc: 0.7208 - val_loss: 0.6660 - val_acc: 0.7222
Epoch 2328/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6614 - acc: 0.7167 - val_loss: 0.6675 - val_acc: 0.7222
Epoch 2329/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6482 - acc: 0.7319 - val_loss: 0.6694 - val_acc: 0.7111
Epoch 2330/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6618 - acc: 0.7153 - val_loss: 0.6713 - val_acc: 0.7056
Epoch 2331/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6632 - acc: 0.7333 - val_loss: 0.6727 - val_acc: 0.7056
Epoch 2332/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6672 - acc: 0.7139 - val_loss: 0.6730 - val_acc: 0.7056
Epoch 2333/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6665 - acc: 0.7250 - val_loss: 0.6722 - val_acc: 0.7056
Epoch 2334/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6715 - acc: 0.7014 - val_loss: 0.6728 - val_acc: 0.7000
Epoch 2335/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6740 - acc: 0.7194 - val_loss: 0.6727 - val_acc: 0.6944
Epoch 2336/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6921 - acc: 0.6917 - val_loss: 0.6723 - val_acc: 0.6944
Epoch 2337/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6760 - acc: 0.7069 - val_loss: 0.6723 - val_acc: 0.6889
Epoch 2338/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6948 - acc: 0.7153 - val_loss: 0.6725 - val_acc: 0.6889
Epoch 2339/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6746 - acc: 0.7236 - val_loss: 0.6717 - val_acc: 0.6944
Epoch 2340/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6704 - acc: 0.7139 - val_loss: 0.6711 - val_acc: 0.7111
Epoch 2341/3000
720/720 [==============================] - 0s 46us/step - loss: 0.6789 - acc: 0.7014 - val_loss: 0.6716 - val_acc: 0.7167
Epoch 2342/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6718 - acc: 0.7111 - val_loss: 0.6720 - val_acc: 0.7167
Epoch 2343/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6773 - acc: 0.7153 - val_loss: 0.6723 - val_acc: 0.7167
Epoch 2344/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6748 - acc: 0.7181 - val_loss: 0.6721 - val_acc: 0.7167
Epoch 2345/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6784 - acc: 0.7056 - val_loss: 0.6719 - val_acc: 0.7167
Epoch 2346/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6788 - acc: 0.7056 - val_loss: 0.6716 - val_acc: 0.7111
Epoch 2347/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6603 - acc: 0.7250 - val_loss: 0.6710 - val_acc: 0.7167
Epoch 2348/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6469 - acc: 0.7111 - val_loss: 0.6705 - val_acc: 0.7167
Epoch 2349/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6790 - acc: 0.7222 - val_loss: 0.6709 - val_acc: 0.7167
Epoch 2350/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6699 - acc: 0.7181 - val_loss: 0.6715 - val_acc: 0.7222
Epoch 2351/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6607 - acc: 0.7306 - val_loss: 0.6717 - val_acc: 0.7278
Epoch 2352/3000
720/720 [==============================] - 0s 32us/step - loss: 0.6834 - acc: 0.7125 - val_loss: 0.6722 - val_acc: 0.7278
Epoch 2353/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6862 - acc: 0.7139 - val_loss: 0.6727 - val_acc: 0.7278
Epoch 2354/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6749 - acc: 0.7111 - val_loss: 0.6733 - val_acc: 0.7278
Epoch 2355/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6581 - acc: 0.7208 - val_loss: 0.6746 - val_acc: 0.7222
Epoch 2356/3000
720/720 [==============================] - 0s 50us/step - loss: 0.6795 - acc: 0.7125 - val_loss: 0.6766 - val_acc: 0.7167
Epoch 2357/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6672 - acc: 0.7250 - val_loss: 0.6779 - val_acc: 0.7222
Epoch 2358/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6691 - acc: 0.7236 - val_loss: 0.6790 - val_acc: 0.7222
Epoch 2359/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6524 - acc: 0.7139 - val_loss: 0.6793 - val_acc: 0.7222
Epoch 2360/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6709 - acc: 0.7208 - val_loss: 0.6801 - val_acc: 0.7222
Epoch 2361/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6648 - acc: 0.7139 - val_loss: 0.6816 - val_acc: 0.7222
Epoch 2362/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6745 - acc: 0.7222 - val_loss: 0.6837 - val_acc: 0.7222
Epoch 2363/3000
720/720 [==============================] - 0s 50us/step - loss: 0.6753 - acc: 0.7069 - val_loss: 0.6864 - val_acc: 0.7278
Epoch 2364/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6732 - acc: 0.7139 - val_loss: 0.6895 - val_acc: 0.7278
Epoch 2365/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6952 - acc: 0.6944 - val_loss: 0.6924 - val_acc: 0.7278
Epoch 2366/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6622 - acc: 0.7264 - val_loss: 0.6936 - val_acc: 0.7278
Epoch 2367/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6638 - acc: 0.6986 - val_loss: 0.6945 - val_acc: 0.7278
Epoch 2368/3000
720/720 [==============================] - 0s 40us/step - loss: 0.6687 - acc: 0.7153 - val_loss: 0.6952 - val_acc: 0.7278
Epoch 2369/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6643 - acc: 0.7069 - val_loss: 0.6956 - val_acc: 0.7278
Epoch 2370/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6598 - acc: 0.7097 - val_loss: 0.6925 - val_acc: 0.7278
Epoch 2371/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6490 - acc: 0.7139 - val_loss: 0.6903 - val_acc: 0.7278
Epoch 2372/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6521 - acc: 0.7111 - val_loss: 0.6885 - val_acc: 0.7278
Epoch 2373/3000
720/720 [==============================] - 0s 47us/step - loss: 0.6403 - acc: 0.7347 - val_loss: 0.6860 - val_acc: 0.7278
Epoch 2374/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6803 - acc: 0.7069 - val_loss: 0.6829 - val_acc: 0.7278
Epoch 2375/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6636 - acc: 0.7056 - val_loss: 0.6801 - val_acc: 0.7222
Epoch 2376/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6581 - acc: 0.7083 - val_loss: 0.6774 - val_acc: 0.7222
Epoch 2377/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6531 - acc: 0.7167 - val_loss: 0.6747 - val_acc: 0.7222
Epoch 2378/3000
720/720 [==============================] - 0s 50us/step - loss: 0.6810 - acc: 0.7139 - val_loss: 0.6735 - val_acc: 0.7222
Epoch 2379/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6783 - acc: 0.7014 - val_loss: 0.6733 - val_acc: 0.7222
Epoch 2380/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6592 - acc: 0.7292 - val_loss: 0.6734 - val_acc: 0.7167
Epoch 2381/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6596 - acc: 0.7306 - val_loss: 0.6741 - val_acc: 0.7167
Epoch 2382/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6588 - acc: 0.7236 - val_loss: 0.6740 - val_acc: 0.7167
Epoch 2383/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6745 - acc: 0.7194 - val_loss: 0.6738 - val_acc: 0.7222
Epoch 2384/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6726 - acc: 0.7167 - val_loss: 0.6731 - val_acc: 0.7222
Epoch 2385/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6433 - acc: 0.7222 - val_loss: 0.6721 - val_acc: 0.7222
Epoch 2386/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6648 - acc: 0.7347 - val_loss: 0.6701 - val_acc: 0.7222
Epoch 2387/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6562 - acc: 0.7181 - val_loss: 0.6695 - val_acc: 0.7222
Epoch 2388/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6611 - acc: 0.7208 - val_loss: 0.6683 - val_acc: 0.7222
Epoch 2389/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6748 - acc: 0.7153 - val_loss: 0.6679 - val_acc: 0.7222
Epoch 2390/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6677 - acc: 0.7056 - val_loss: 0.6677 - val_acc: 0.7167
Epoch 2391/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6625 - acc: 0.7153 - val_loss: 0.6679 - val_acc: 0.7167
Epoch 2392/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6753 - acc: 0.7056 - val_loss: 0.6674 - val_acc: 0.7167
Epoch 2393/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6858 - acc: 0.6931 - val_loss: 0.6681 - val_acc: 0.7167
Epoch 2394/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6665 - acc: 0.7000 - val_loss: 0.6683 - val_acc: 0.7167
Epoch 2395/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6480 - acc: 0.7278 - val_loss: 0.6677 - val_acc: 0.7222
Epoch 2396/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6463 - acc: 0.7250 - val_loss: 0.6676 - val_acc: 0.7222
Epoch 2397/3000
720/720 [==============================] - 0s 50us/step - loss: 0.6555 - acc: 0.7153 - val_loss: 0.6684 - val_acc: 0.7222
Epoch 2398/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6607 - acc: 0.7292 - val_loss: 0.6688 - val_acc: 0.7222
Epoch 2399/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6509 - acc: 0.7181 - val_loss: 0.6687 - val_acc: 0.7167
Epoch 2400/3000
720/720 [==============================] - 0s 51us/step - loss: 0.6790 - acc: 0.7319 - val_loss: 0.6698 - val_acc: 0.7222
Epoch 2401/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6695 - acc: 0.6944 - val_loss: 0.6702 - val_acc: 0.7222
Epoch 2402/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6712 - acc: 0.7208 - val_loss: 0.6715 - val_acc: 0.7222
Epoch 2403/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6627 - acc: 0.7097 - val_loss: 0.6720 - val_acc: 0.7222
Epoch 2404/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6545 - acc: 0.7028 - val_loss: 0.6724 - val_acc: 0.7222
Epoch 2405/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6546 - acc: 0.7264 - val_loss: 0.6723 - val_acc: 0.7222
Epoch 2406/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6439 - acc: 0.7250 - val_loss: 0.6725 - val_acc: 0.7167
Epoch 2407/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6645 - acc: 0.7319 - val_loss: 0.6719 - val_acc: 0.7167
Epoch 2408/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6738 - acc: 0.7139 - val_loss: 0.6687 - val_acc: 0.7167
Epoch 2409/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6670 - acc: 0.7250 - val_loss: 0.6652 - val_acc: 0.7111
Epoch 2410/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6594 - acc: 0.7236 - val_loss: 0.6615 - val_acc: 0.7111
Epoch 2411/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6819 - acc: 0.6917 - val_loss: 0.6589 - val_acc: 0.7111
Epoch 2412/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6754 - acc: 0.7097 - val_loss: 0.6565 - val_acc: 0.7222
Epoch 2413/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6780 - acc: 0.7208 - val_loss: 0.6553 - val_acc: 0.7222
Epoch 2414/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6739 - acc: 0.7042 - val_loss: 0.6545 - val_acc: 0.7167
Epoch 2415/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6599 - acc: 0.7236 - val_loss: 0.6541 - val_acc: 0.7222
Epoch 2416/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6803 - acc: 0.7056 - val_loss: 0.6537 - val_acc: 0.7222
Epoch 2417/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6828 - acc: 0.7278 - val_loss: 0.6535 - val_acc: 0.7222
Epoch 2418/3000
720/720 [==============================] - 0s 44us/step - loss: 0.6571 - acc: 0.7111 - val_loss: 0.6537 - val_acc: 0.7222
Epoch 2419/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6459 - acc: 0.7194 - val_loss: 0.6535 - val_acc: 0.7222
Epoch 2420/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6681 - acc: 0.7056 - val_loss: 0.6536 - val_acc: 0.7222
Epoch 2421/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6713 - acc: 0.7347 - val_loss: 0.6544 - val_acc: 0.7222
Epoch 2422/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6766 - acc: 0.7278 - val_loss: 0.6540 - val_acc: 0.7222
Epoch 2423/3000
720/720 [==============================] - 0s 51us/step - loss: 0.6768 - acc: 0.7014 - val_loss: 0.6543 - val_acc: 0.7167
Epoch 2424/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6733 - acc: 0.7181 - val_loss: 0.6545 - val_acc: 0.7167
Epoch 2425/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6773 - acc: 0.7264 - val_loss: 0.6548 - val_acc: 0.7111
Epoch 2426/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6597 - acc: 0.7139 - val_loss: 0.6546 - val_acc: 0.7222
Epoch 2427/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6549 - acc: 0.7181 - val_loss: 0.6543 - val_acc: 0.7222
Epoch 2428/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6499 - acc: 0.7139 - val_loss: 0.6545 - val_acc: 0.7278
Epoch 2429/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6569 - acc: 0.7264 - val_loss: 0.6545 - val_acc: 0.7222
Epoch 2430/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6582 - acc: 0.7028 - val_loss: 0.6547 - val_acc: 0.7167
Epoch 2431/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6621 - acc: 0.7125 - val_loss: 0.6546 - val_acc: 0.7056
Epoch 2432/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6559 - acc: 0.7181 - val_loss: 0.6545 - val_acc: 0.7056
Epoch 2433/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6845 - acc: 0.7153 - val_loss: 0.6544 - val_acc: 0.7056
Epoch 2434/3000
720/720 [==============================] - 0s 49us/step - loss: 0.6558 - acc: 0.7153 - val_loss: 0.6546 - val_acc: 0.7000
Epoch 2435/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6769 - acc: 0.7153 - val_loss: 0.6552 - val_acc: 0.7000
Epoch 2436/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6905 - acc: 0.7028 - val_loss: 0.6565 - val_acc: 0.7000
Epoch 2437/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6576 - acc: 0.7403 - val_loss: 0.6578 - val_acc: 0.7000
Epoch 2438/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6580 - acc: 0.7236 - val_loss: 0.6593 - val_acc: 0.7000
Epoch 2439/3000
720/720 [==============================] - 0s 50us/step - loss: 0.6745 - acc: 0.7139 - val_loss: 0.6605 - val_acc: 0.7056
Epoch 2440/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6697 - acc: 0.7153 - val_loss: 0.6618 - val_acc: 0.7111
Epoch 2441/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6550 - acc: 0.7194 - val_loss: 0.6637 - val_acc: 0.7000
Epoch 2442/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6845 - acc: 0.7125 - val_loss: 0.6653 - val_acc: 0.7000
Epoch 2443/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6739 - acc: 0.7028 - val_loss: 0.6677 - val_acc: 0.6833
Epoch 2444/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6677 - acc: 0.7264 - val_loss: 0.6697 - val_acc: 0.6889
Epoch 2445/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6783 - acc: 0.7083 - val_loss: 0.6728 - val_acc: 0.6889
Epoch 2446/3000
720/720 [==============================] - 0s 40us/step - loss: 0.6612 - acc: 0.7153 - val_loss: 0.6746 - val_acc: 0.6833
Epoch 2447/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6627 - acc: 0.7139 - val_loss: 0.6755 - val_acc: 0.6944
Epoch 2448/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6499 - acc: 0.7111 - val_loss: 0.6770 - val_acc: 0.6944
Epoch 2449/3000
720/720 [==============================] - 0s 12us/step - loss: 0.6642 - acc: 0.7208 - val_loss: 0.6785 - val_acc: 0.6944
Epoch 2450/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6670 - acc: 0.7181 - val_loss: 0.6790 - val_acc: 0.6944
Epoch 2451/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6780 - acc: 0.7056 - val_loss: 0.6788 - val_acc: 0.6944
Epoch 2452/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6653 - acc: 0.7125 - val_loss: 0.6780 - val_acc: 0.6944
Epoch 2453/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6615 - acc: 0.7069 - val_loss: 0.6769 - val_acc: 0.7000
Epoch 2454/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6662 - acc: 0.7194 - val_loss: 0.6755 - val_acc: 0.7000
Epoch 2455/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6551 - acc: 0.7042 - val_loss: 0.6748 - val_acc: 0.7000
Epoch 2456/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6832 - acc: 0.6972 - val_loss: 0.6740 - val_acc: 0.6944
Epoch 2457/3000
720/720 [==============================] - 0s 13us/step - loss: 0.6729 - acc: 0.7125 - val_loss: 0.6732 - val_acc: 0.6944
Epoch 2458/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6735 - acc: 0.7111 - val_loss: 0.6731 - val_acc: 0.6944
Epoch 2459/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6822 - acc: 0.7208 - val_loss: 0.6737 - val_acc: 0.7000
Epoch 2460/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6623 - acc: 0.7292 - val_loss: 0.6734 - val_acc: 0.7000
Epoch 2461/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6738 - acc: 0.7236 - val_loss: 0.6723 - val_acc: 0.7000
Epoch 2462/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6594 - acc: 0.7167 - val_loss: 0.6707 - val_acc: 0.6944
Epoch 2463/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6645 - acc: 0.7250 - val_loss: 0.6696 - val_acc: 0.6944
Epoch 2464/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6603 - acc: 0.7167 - val_loss: 0.6681 - val_acc: 0.7056
Epoch 2465/3000
720/720 [==============================] - 0s 47us/step - loss: 0.6713 - acc: 0.7153 - val_loss: 0.6667 - val_acc: 0.7222
Epoch 2466/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6467 - acc: 0.7167 - val_loss: 0.6659 - val_acc: 0.7278
Epoch 2467/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6594 - acc: 0.7097 - val_loss: 0.6654 - val_acc: 0.7222
Epoch 2468/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6389 - acc: 0.7389 - val_loss: 0.6656 - val_acc: 0.7056
Epoch 2469/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6655 - acc: 0.7278 - val_loss: 0.6652 - val_acc: 0.7056
Epoch 2470/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6657 - acc: 0.7167 - val_loss: 0.6649 - val_acc: 0.7056
Epoch 2471/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6433 - acc: 0.7278 - val_loss: 0.6637 - val_acc: 0.7111
Epoch 2472/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6553 - acc: 0.7139 - val_loss: 0.6628 - val_acc: 0.7111
Epoch 2473/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6341 - acc: 0.7250 - val_loss: 0.6632 - val_acc: 0.7056
Epoch 2474/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6714 - acc: 0.7139 - val_loss: 0.6639 - val_acc: 0.7000
Epoch 2475/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6667 - acc: 0.7167 - val_loss: 0.6644 - val_acc: 0.7000
Epoch 2476/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6860 - acc: 0.6986 - val_loss: 0.6644 - val_acc: 0.7111
Epoch 2477/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6791 - acc: 0.7181 - val_loss: 0.6641 - val_acc: 0.7111
Epoch 2478/3000
720/720 [==============================] - 0s 51us/step - loss: 0.6535 - acc: 0.7194 - val_loss: 0.6641 - val_acc: 0.7111
Epoch 2479/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6759 - acc: 0.7181 - val_loss: 0.6646 - val_acc: 0.7111
Epoch 2480/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6619 - acc: 0.7264 - val_loss: 0.6656 - val_acc: 0.7111
Epoch 2481/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6663 - acc: 0.7014 - val_loss: 0.6668 - val_acc: 0.7056
Epoch 2482/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6589 - acc: 0.7194 - val_loss: 0.6669 - val_acc: 0.7056
Epoch 2483/3000
720/720 [==============================] - 0s 40us/step - loss: 0.6593 - acc: 0.7125 - val_loss: 0.6670 - val_acc: 0.7056
Epoch 2484/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6597 - acc: 0.7069 - val_loss: 0.6665 - val_acc: 0.7000
Epoch 2485/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6656 - acc: 0.7083 - val_loss: 0.6665 - val_acc: 0.7000
Epoch 2486/3000
720/720 [==============================] - 0s 18us/step - loss: 0.6602 - acc: 0.7167 - val_loss: 0.6663 - val_acc: 0.6944
Epoch 2487/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6580 - acc: 0.7250 - val_loss: 0.6667 - val_acc: 0.6944
Epoch 2488/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6628 - acc: 0.7083 - val_loss: 0.6675 - val_acc: 0.7000
Epoch 2489/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6723 - acc: 0.7181 - val_loss: 0.6666 - val_acc: 0.6944
Epoch 2490/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6707 - acc: 0.7097 - val_loss: 0.6656 - val_acc: 0.7000
Epoch 2491/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6679 - acc: 0.7153 - val_loss: 0.6638 - val_acc: 0.7000
Epoch 2492/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6612 - acc: 0.7167 - val_loss: 0.6611 - val_acc: 0.7056
Epoch 2493/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6571 - acc: 0.7111 - val_loss: 0.6588 - val_acc: 0.7056
Epoch 2494/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6471 - acc: 0.7208 - val_loss: 0.6572 - val_acc: 0.7111
Epoch 2495/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6640 - acc: 0.7111 - val_loss: 0.6566 - val_acc: 0.7167
Epoch 2496/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6677 - acc: 0.7139 - val_loss: 0.6563 - val_acc: 0.7167
Epoch 2497/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6675 - acc: 0.7097 - val_loss: 0.6562 - val_acc: 0.7222
Epoch 2498/3000
720/720 [==============================] - 0s 35us/step - loss: 0.6612 - acc: 0.7139 - val_loss: 0.6557 - val_acc: 0.7222
Epoch 2499/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6427 - acc: 0.7028 - val_loss: 0.6555 - val_acc: 0.7222
Epoch 2500/3000
720/720 [==============================] - 0s 21us/step - loss: 0.6686 - acc: 0.7167 - val_loss: 0.6549 - val_acc: 0.7222
Epoch 2501/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6938 - acc: 0.7181 - val_loss: 0.6541 - val_acc: 0.7278
Epoch 2502/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6654 - acc: 0.7167 - val_loss: 0.6537 - val_acc: 0.7278
Epoch 2503/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6670 - acc: 0.7264 - val_loss: 0.6531 - val_acc: 0.7333
Epoch 2504/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6576 - acc: 0.7083 - val_loss: 0.6527 - val_acc: 0.7333
Epoch 2505/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6681 - acc: 0.7236 - val_loss: 0.6520 - val_acc: 0.7333
Epoch 2506/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6624 - acc: 0.7278 - val_loss: 0.6518 - val_acc: 0.7333
Epoch 2507/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6679 - acc: 0.7250 - val_loss: 0.6517 - val_acc: 0.7389
Epoch 2508/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6560 - acc: 0.7250 - val_loss: 0.6515 - val_acc: 0.7389
Epoch 2509/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6707 - acc: 0.7069 - val_loss: 0.6516 - val_acc: 0.7333
Epoch 2510/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6631 - acc: 0.7167 - val_loss: 0.6516 - val_acc: 0.7333
Epoch 2511/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6839 - acc: 0.7000 - val_loss: 0.6518 - val_acc: 0.7333
Epoch 2512/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6724 - acc: 0.7083 - val_loss: 0.6522 - val_acc: 0.7333
Epoch 2513/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6620 - acc: 0.7167 - val_loss: 0.6527 - val_acc: 0.7333
Epoch 2514/3000
720/720 [==============================] - 0s 33us/step - loss: 0.6906 - acc: 0.7069 - val_loss: 0.6528 - val_acc: 0.7278
Epoch 2515/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6505 - acc: 0.7292 - val_loss: 0.6532 - val_acc: 0.7222
Epoch 2516/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6791 - acc: 0.7000 - val_loss: 0.6541 - val_acc: 0.7111
Epoch 2517/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6551 - acc: 0.7042 - val_loss: 0.6548 - val_acc: 0.7111
Epoch 2518/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6743 - acc: 0.7083 - val_loss: 0.6554 - val_acc: 0.7111
Epoch 2519/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6793 - acc: 0.7083 - val_loss: 0.6559 - val_acc: 0.7056
Epoch 2520/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6674 - acc: 0.7125 - val_loss: 0.6568 - val_acc: 0.7056
Epoch 2521/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6657 - acc: 0.7125 - val_loss: 0.6571 - val_acc: 0.7000
Epoch 2522/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6602 - acc: 0.7125 - val_loss: 0.6578 - val_acc: 0.7056
Epoch 2523/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6658 - acc: 0.7194 - val_loss: 0.6596 - val_acc: 0.7000
Epoch 2524/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6567 - acc: 0.7153 - val_loss: 0.6610 - val_acc: 0.7000
Epoch 2525/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6730 - acc: 0.7125 - val_loss: 0.6620 - val_acc: 0.7000
Epoch 2526/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6403 - acc: 0.7167 - val_loss: 0.6631 - val_acc: 0.7000
Epoch 2527/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6702 - acc: 0.7097 - val_loss: 0.6632 - val_acc: 0.7000
Epoch 2528/3000
720/720 [==============================] - 0s 19us/step - loss: 0.6428 - acc: 0.7056 - val_loss: 0.6625 - val_acc: 0.7000
Epoch 2529/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6406 - acc: 0.7236 - val_loss: 0.6616 - val_acc: 0.7000
Epoch 2530/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6360 - acc: 0.7250 - val_loss: 0.6609 - val_acc: 0.7000
Epoch 2531/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6561 - acc: 0.7167 - val_loss: 0.6595 - val_acc: 0.7056
Epoch 2532/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6749 - acc: 0.6889 - val_loss: 0.6586 - val_acc: 0.7111
Epoch 2533/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6673 - acc: 0.7111 - val_loss: 0.6576 - val_acc: 0.7222
Epoch 2534/3000
720/720 [==============================] - 0s 26us/step - loss: 0.6652 - acc: 0.7222 - val_loss: 0.6567 - val_acc: 0.7222
Epoch 2535/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6531 - acc: 0.7194 - val_loss: 0.6563 - val_acc: 0.7278
Epoch 2536/3000
720/720 [==============================] - 0s 29us/step - loss: 0.6600 - acc: 0.7139 - val_loss: 0.6565 - val_acc: 0.7278
Epoch 2537/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6720 - acc: 0.7125 - val_loss: 0.6574 - val_acc: 0.7222
Epoch 2538/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6744 - acc: 0.7097 - val_loss: 0.6581 - val_acc: 0.7222
Epoch 2539/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6431 - acc: 0.7306 - val_loss: 0.6583 - val_acc: 0.7222
Epoch 2540/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6528 - acc: 0.7194 - val_loss: 0.6580 - val_acc: 0.7222
Epoch 2541/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6510 - acc: 0.7292 - val_loss: 0.6570 - val_acc: 0.7278
Epoch 2542/3000
720/720 [==============================] - 0s 24us/step - loss: 0.6615 - acc: 0.7236 - val_loss: 0.6562 - val_acc: 0.7278
Epoch 2543/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6435 - acc: 0.7236 - val_loss: 0.6561 - val_acc: 0.7333
Epoch 2544/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6603 - acc: 0.7181 - val_loss: 0.6563 - val_acc: 0.7278
Epoch 2545/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6719 - acc: 0.7069 - val_loss: 0.6558 - val_acc: 0.7222
Epoch 2546/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6674 - acc: 0.7181 - val_loss: 0.6555 - val_acc: 0.7222
Epoch 2547/3000
720/720 [==============================] - 0s 14us/step - loss: 0.6555 - acc: 0.7222 - val_loss: 0.6557 - val_acc: 0.7222
Epoch 2548/3000
720/720 [==============================] - 0s 25us/step - loss: 0.6674 - acc: 0.7097 - val_loss: 0.6558 - val_acc: 0.7222
Epoch 2549/3000
720/720 [==============================] - 0s 31us/step - loss: 0.6716 - acc: 0.7139 - val_loss: 0.6559 - val_acc: 0.7222
Epoch 2550/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6593 - acc: 0.6972 - val_loss: 0.6562 - val_acc: 0.7222
Epoch 2551/3000
720/720 [==============================] - 0s 28us/step - loss: 0.6552 - acc: 0.7083 - val_loss: 0.6569 - val_acc: 0.7222
Epoch 2552/3000
720/720 [==============================] - 0s 17us/step - loss: 0.6725 - acc: 0.7208 - val_loss: 0.6576 - val_acc: 0.7222
Epoch 2553/3000
720/720 [==============================] - 0s 15us/step - loss: 0.6570 - acc: 0.7181 - val_loss: 0.6586 - val_acc: 0.7222
Epoch 2554/3000
720/720 [==============================] - 0s 38us/step - loss: 0.6413 - acc: 0.7181 - val_loss: 0.6598 - val_acc: 0.7222
Epoch 2555/3000
720/720 [==============================] - 0s 22us/step - loss: 0.6682 - acc: 0.7181 - val_loss: 0.6608 - val_acc: 0.7222
Epoch 02555: early stopping
Wall time: 39.5 s






    Out[102]:





<tensorflow.python.keras._impl.keras.callbacks.History at 0x1f26f80c898>



In [103]:

    
# use the best model
# from keras.models import load_model

# model = load_model('keras-model.hdf5')



In [104]:

    
train_loss, train_accuracy = model.evaluate(X_train_2_dim, y_train_categorical, batch_size=BATCH_SIZE)
train_accuracy









    



900/900 [==============================] - 0s 3us/step






    Out[104]:





0.7311111092567444



In [105]:

    
test_loss, test_accuracy = model.evaluate(X_test_2_dim, y_test_categorical, batch_size=BATCH_SIZE)
test_accuracy









    



600/600 [==============================] - 0s 15us/step






    Out[105]:





0.7183333039283752



In [106]:

    
plot_keras_prediction(model, X_test_2_dim[:, 1], X_test_2_dim[:, 0], 
               'Age', 'Max Speed', y_test,
                title="Test Data, Dropout, BachNormalization, Reduced Cap NN",
                fname='nn-reg-test.png')

It is surprising how smooth and very similar these decision boundaries are to the ones created by SVM



In [ ]:

	max speed	age	thousand km per year	group
0	148.0	44.0	25.0	1
1	168.0	54.0	24.0	1
2	161.0	26.0	34.0	0
3	137.0	25.0	10.0	2
4	164.0	38.0	22.0	1

	max speed	age	thousand km per year	group
count	1500.000000	1500.000000	1500.000000	1500.000000
mean	171.386000	44.969333	30.511333	0.998667
std	19.269126	16.935040	15.112317	0.816768
min	118.000000	18.000000	5.000000	0.000000
25%	158.000000	32.000000	18.000000	0.000000
50%	170.000000	42.000000	29.000000	1.000000
75%	187.000000	55.000000	42.000000	2.000000
max	216.000000	90.000000	84.000000	2.000000