notebook.community

Edit and run

Convolutional Autoencoder

Yeah, I'm apparently actually doing this.

Structure is roughly as follows.

  • Convolutional layer
  • Symmetric(!!!) activation layer
  • Max pooling layer
  • Dropout layer
  • Flatten layer
  • Dense layer
  • Symmetric activation layer
  • Unflatten layer
  • Unpool layer
  • Deconvolutional layer
  • Symmetric activation layer

Inspiration from https://github.com/mikesj-public/convolutional_autoencoder/blob/master/mnist_conv_autoencode.py and https://github.com/nanopony/keras-convautoencoder/blob/master/conv_autoencoder.py.

Let's load up the dataset I put up on Zenodo.





In [52]:



    


import h5py, numpy

with h5py.File('../data/dataset.h5', 'r') as f:
    features = f['features'][:, -32 * 32:]

Now we'll build an autoencoder...





In [157]:



    


import keras, \
        keras.layers, \
        keras.layers.core as core, \
        keras.layers.convolutional as conv, \
        keras.models as models
from keras import backend as K
from keras.engine.topology import Layer

n_filters = 32
conv_size = 5
pool_size = 2
dropout = 0.25
patch_size = 32
conv_out_size = (patch_size - conv_size) // pool_size + 1
conv_2_out_size = ((patch_size - conv_size) // pool_size + 1 - conv_size) // pool_size + 1
hidden = 1500



    











In [54]:



    


class Sum(Layer):
    def __init__(self, **kwargs):
        super(Sum, self).__init__(**kwargs)

    def build(self, input_shape):
        self.trainable_weights = []

    def call(self, x, mask=None):
        return x.sum(axis=1)

    def get_output_shape_for(self, input_shape):
        return (input_shape[0],) + input_shape[2:]



    











In [160]:



    


model = models.Sequential()

# Encoder.
model.add(conv.Convolution2D(n_filters, conv_size, conv_size,
                             border_mode='valid',
                             input_shape=(1, patch_size, patch_size)))
model.add(core.Activation('tanh'))
model.add(conv.MaxPooling2D(pool_size=(pool_size, pool_size)))
model.add(core.Dropout(dropout))
model.add(conv.Convolution2D(n_filters, conv_size, conv_size,
                             border_mode='valid'))
model.add(core.Activation('tanh'))
model.add(conv.MaxPooling2D(pool_size=(pool_size, pool_size)))
model.add(core.Dropout(dropout))
model.add(core.Flatten())

# Dense.
# model.add(core.Dense(hidden))
# model.add(core.Activation('tanh'))
# model.add(core.Dense(n_filters * conv_out_size * conv_out_size))
# model.add(core.Activation('tanh'))

# Decoder.
model.add(core.Reshape((n_filters, conv_2_out_size, conv_2_out_size)))
model.add(conv.UpSampling2D(size=(pool_size, pool_size)))
model.add(core.Activation('tanh'))
model.add(conv.ZeroPadding2D(padding=(conv_size - 1, conv_size - 1)))
model.add(conv.Convolution2D(n_filters, conv_size, conv_size,
                            border_mode='valid'))
model.add(conv.UpSampling2D(size=(pool_size, pool_size)))
model.add(core.Activation('tanh'))
model.add(conv.ZeroPadding2D(padding=(conv_size - 1, conv_size - 1)))
model.add(conv.Convolution2D(n_filters, conv_size, conv_size,
                            border_mode='valid'))
model.add(Sum())

model.compile(loss='mse', optimizer='adagrad')



    











In [180]:



    


images = features.reshape((-1, patch_size, patch_size))
model.fit(images[:10].reshape((-1, 1, patch_size, patch_size)), images[:10], nb_epoch=1000)



    


















    






Epoch 1/1000
10/10 [==============================] - 0s - loss: 0.5183
Epoch 2/1000
10/10 [==============================] - 0s - loss: 0.5000
Epoch 3/1000
10/10 [==============================] - 0s - loss: 0.4398
Epoch 4/1000
10/10 [==============================] - 0s - loss: 0.5241
Epoch 5/1000
10/10 [==============================] - 0s - loss: 0.5176
Epoch 6/1000
10/10 [==============================] - 0s - loss: 0.5136
Epoch 7/1000
10/10 [==============================] - 0s - loss: 0.5556
Epoch 8/1000
10/10 [==============================] - 0s - loss: 0.4834
Epoch 9/1000
10/10 [==============================] - 0s - loss: 0.4910
Epoch 10/1000
10/10 [==============================] - 0s - loss: 0.5520
Epoch 11/1000
10/10 [==============================] - 0s - loss: 0.4347
Epoch 12/1000
10/10 [==============================] - 0s - loss: 0.4886
Epoch 13/1000
10/10 [==============================] - 0s - loss: 0.4431
Epoch 14/1000
10/10 [==============================] - 0s - loss: 0.4581
Epoch 15/1000
10/10 [==============================] - 0s - loss: 0.4971
Epoch 16/1000
10/10 [==============================] - 0s - loss: 0.5164
Epoch 17/1000
10/10 [==============================] - 0s - loss: 0.4710
Epoch 18/1000
10/10 [==============================] - 0s - loss: 0.4916
Epoch 19/1000
10/10 [==============================] - 0s - loss: 0.5236
Epoch 20/1000
10/10 [==============================] - 0s - loss: 0.5407
Epoch 21/1000
10/10 [==============================] - 0s - loss: 0.4444
Epoch 22/1000
10/10 [==============================] - 0s - loss: 0.4784
Epoch 23/1000
10/10 [==============================] - 0s - loss: 0.4843
Epoch 24/1000
10/10 [==============================] - 0s - loss: 0.4776
Epoch 25/1000
10/10 [==============================] - 0s - loss: 0.4426
Epoch 26/1000
10/10 [==============================] - 0s - loss: 0.4254
Epoch 27/1000
10/10 [==============================] - 0s - loss: 0.4327
Epoch 28/1000
10/10 [==============================] - 0s - loss: 0.5842
Epoch 29/1000
10/10 [==============================] - 0s - loss: 0.5101
Epoch 30/1000
10/10 [==============================] - 0s - loss: 0.5156
Epoch 31/1000
10/10 [==============================] - 0s - loss: 0.4932
Epoch 32/1000
10/10 [==============================] - 0s - loss: 0.4337
Epoch 33/1000
10/10 [==============================] - 0s - loss: 0.4074
Epoch 34/1000
10/10 [==============================] - 0s - loss: 0.4820
Epoch 35/1000
10/10 [==============================] - 0s - loss: 0.4277
Epoch 36/1000
10/10 [==============================] - 0s - loss: 0.4552
Epoch 37/1000
10/10 [==============================] - 0s - loss: 0.4786
Epoch 38/1000
10/10 [==============================] - 0s - loss: 0.5636
Epoch 39/1000
10/10 [==============================] - 0s - loss: 0.5549
Epoch 40/1000
10/10 [==============================] - 0s - loss: 0.4583
Epoch 41/1000
10/10 [==============================] - 0s - loss: 0.4769
Epoch 42/1000
10/10 [==============================] - 0s - loss: 0.4668
Epoch 43/1000
10/10 [==============================] - 0s - loss: 0.4330
Epoch 44/1000
10/10 [==============================] - 0s - loss: 0.6009
Epoch 45/1000
10/10 [==============================] - 0s - loss: 0.4283
Epoch 46/1000
10/10 [==============================] - 0s - loss: 0.4665
Epoch 47/1000
10/10 [==============================] - 0s - loss: 0.5342
Epoch 48/1000
10/10 [==============================] - 0s - loss: 0.4395
Epoch 49/1000
10/10 [==============================] - 0s - loss: 0.4108
Epoch 50/1000
10/10 [==============================] - 0s - loss: 0.4168
Epoch 51/1000
10/10 [==============================] - 0s - loss: 0.4925
Epoch 52/1000
10/10 [==============================] - 0s - loss: 0.4878
Epoch 53/1000
10/10 [==============================] - 0s - loss: 0.4445
Epoch 54/1000
10/10 [==============================] - 0s - loss: 0.4787
Epoch 55/1000
10/10 [==============================] - 0s - loss: 0.4413
Epoch 56/1000
10/10 [==============================] - 0s - loss: 0.4198
Epoch 57/1000
10/10 [==============================] - 0s - loss: 0.5227
Epoch 58/1000
10/10 [==============================] - 0s - loss: 0.5530
Epoch 59/1000
10/10 [==============================] - 0s - loss: 0.4983
Epoch 60/1000
10/10 [==============================] - 0s - loss: 0.5632
Epoch 61/1000
10/10 [==============================] - 0s - loss: 0.4690
Epoch 62/1000
10/10 [==============================] - 0s - loss: 0.4327
Epoch 63/1000
10/10 [==============================] - 0s - loss: 0.4842
Epoch 64/1000
10/10 [==============================] - 0s - loss: 0.4645
Epoch 65/1000
10/10 [==============================] - 0s - loss: 0.4773
Epoch 66/1000
10/10 [==============================] - 0s - loss: 0.4994
Epoch 67/1000
10/10 [==============================] - 0s - loss: 0.4516
Epoch 68/1000
10/10 [==============================] - 0s - loss: 0.4239
Epoch 69/1000
10/10 [==============================] - 0s - loss: 0.4597
Epoch 70/1000
10/10 [==============================] - 0s - loss: 0.4127
Epoch 71/1000
10/10 [==============================] - 0s - loss: 0.5591
Epoch 72/1000
10/10 [==============================] - 0s - loss: 0.4304
Epoch 73/1000
10/10 [==============================] - 0s - loss: 0.4075
Epoch 74/1000
10/10 [==============================] - 0s - loss: 0.4748
Epoch 75/1000
10/10 [==============================] - 0s - loss: 0.4291
Epoch 76/1000
10/10 [==============================] - 0s - loss: 0.4729
Epoch 77/1000
10/10 [==============================] - 0s - loss: 0.3973
Epoch 78/1000
10/10 [==============================] - 0s - loss: 0.5305
Epoch 79/1000
10/10 [==============================] - 0s - loss: 0.4586
Epoch 80/1000
10/10 [==============================] - 0s - loss: 0.3983
Epoch 81/1000
10/10 [==============================] - 0s - loss: 0.4490
Epoch 82/1000
10/10 [==============================] - 0s - loss: 0.4517
Epoch 83/1000
10/10 [==============================] - 0s - loss: 0.4424
Epoch 84/1000
10/10 [==============================] - 0s - loss: 0.5038
Epoch 85/1000
10/10 [==============================] - 0s - loss: 0.4410
Epoch 86/1000
10/10 [==============================] - 0s - loss: 0.5346
Epoch 87/1000
10/10 [==============================] - 0s - loss: 0.4481
Epoch 88/1000
10/10 [==============================] - 0s - loss: 0.4101
Epoch 89/1000
10/10 [==============================] - 0s - loss: 0.4333
Epoch 90/1000
10/10 [==============================] - 0s - loss: 0.4938
Epoch 91/1000
10/10 [==============================] - 0s - loss: 0.4638
Epoch 92/1000
10/10 [==============================] - 0s - loss: 0.4627
Epoch 93/1000
10/10 [==============================] - 0s - loss: 0.4671
Epoch 94/1000
10/10 [==============================] - 0s - loss: 0.4118
Epoch 95/1000
10/10 [==============================] - 0s - loss: 0.4419
Epoch 96/1000
10/10 [==============================] - 0s - loss: 0.4077
Epoch 97/1000
10/10 [==============================] - 0s - loss: 0.4332
Epoch 98/1000
10/10 [==============================] - 0s - loss: 0.5523
Epoch 99/1000
10/10 [==============================] - 0s - loss: 0.4269
Epoch 100/1000
10/10 [==============================] - 0s - loss: 0.5199
Epoch 101/1000
10/10 [==============================] - 0s - loss: 0.4388
Epoch 102/1000
10/10 [==============================] - 0s - loss: 0.4323
Epoch 103/1000
10/10 [==============================] - 0s - loss: 0.4329
Epoch 104/1000
10/10 [==============================] - 0s - loss: 0.3669
Epoch 105/1000
10/10 [==============================] - 0s - loss: 0.4281
Epoch 106/1000
10/10 [==============================] - 0s - loss: 0.4549
Epoch 107/1000
10/10 [==============================] - 0s - loss: 0.5027
Epoch 108/1000
10/10 [==============================] - 0s - loss: 0.4144
Epoch 109/1000
10/10 [==============================] - 0s - loss: 0.4031
Epoch 110/1000
10/10 [==============================] - 0s - loss: 0.4803
Epoch 111/1000
10/10 [==============================] - 0s - loss: 0.5052
Epoch 112/1000
10/10 [==============================] - 0s - loss: 0.4461
Epoch 113/1000
10/10 [==============================] - 0s - loss: 0.4647
Epoch 114/1000
10/10 [==============================] - 0s - loss: 0.3578
Epoch 115/1000
10/10 [==============================] - 0s - loss: 0.4957
Epoch 116/1000
10/10 [==============================] - 0s - loss: 0.4426
Epoch 117/1000
10/10 [==============================] - 0s - loss: 0.4077
Epoch 118/1000
10/10 [==============================] - 0s - loss: 0.4273
Epoch 119/1000
10/10 [==============================] - 0s - loss: 0.3885
Epoch 120/1000
10/10 [==============================] - 0s - loss: 0.4176
Epoch 121/1000
10/10 [==============================] - 0s - loss: 0.4255
Epoch 122/1000
10/10 [==============================] - 0s - loss: 0.4044
Epoch 123/1000
10/10 [==============================] - 0s - loss: 0.3780
Epoch 124/1000
10/10 [==============================] - 0s - loss: 0.4341
Epoch 125/1000
10/10 [==============================] - 0s - loss: 0.4090
Epoch 126/1000
10/10 [==============================] - 0s - loss: 0.3645
Epoch 127/1000
10/10 [==============================] - 0s - loss: 0.4440
Epoch 128/1000
10/10 [==============================] - 0s - loss: 0.4071
Epoch 129/1000
10/10 [==============================] - 0s - loss: 0.3718
Epoch 130/1000
10/10 [==============================] - 0s - loss: 0.4383
Epoch 131/1000
10/10 [==============================] - 0s - loss: 0.3916
Epoch 132/1000
10/10 [==============================] - 0s - loss: 0.3867
Epoch 133/1000
10/10 [==============================] - 0s - loss: 0.3963
Epoch 134/1000
10/10 [==============================] - 0s - loss: 0.3715
Epoch 135/1000
10/10 [==============================] - 0s - loss: 0.4760
Epoch 136/1000
10/10 [==============================] - 0s - loss: 0.3741
Epoch 137/1000
10/10 [==============================] - 0s - loss: 0.4413
Epoch 138/1000
10/10 [==============================] - 0s - loss: 0.4121
Epoch 139/1000
10/10 [==============================] - 0s - loss: 0.3750
Epoch 140/1000
10/10 [==============================] - 0s - loss: 0.3985
Epoch 141/1000
10/10 [==============================] - 0s - loss: 0.3580
Epoch 142/1000
10/10 [==============================] - 0s - loss: 0.3890
Epoch 143/1000
10/10 [==============================] - 0s - loss: 0.4196
Epoch 144/1000
10/10 [==============================] - 0s - loss: 0.4416
Epoch 145/1000
10/10 [==============================] - 0s - loss: 0.4168
Epoch 146/1000
10/10 [==============================] - 0s - loss: 0.4370
Epoch 147/1000
10/10 [==============================] - 0s - loss: 0.3950
Epoch 148/1000
10/10 [==============================] - 0s - loss: 0.4589
Epoch 149/1000
10/10 [==============================] - 0s - loss: 0.4563
Epoch 150/1000
10/10 [==============================] - 0s - loss: 0.3542
Epoch 151/1000
10/10 [==============================] - 0s - loss: 0.3933
Epoch 152/1000
10/10 [==============================] - 0s - loss: 0.4614
Epoch 153/1000
10/10 [==============================] - 0s - loss: 0.3444
Epoch 154/1000
10/10 [==============================] - 0s - loss: 0.4225
Epoch 155/1000
10/10 [==============================] - 0s - loss: 0.3292
Epoch 156/1000
10/10 [==============================] - 0s - loss: 0.4145
Epoch 157/1000
10/10 [==============================] - 0s - loss: 0.3937
Epoch 158/1000
10/10 [==============================] - 0s - loss: 0.3624
Epoch 159/1000
10/10 [==============================] - 0s - loss: 0.4287
Epoch 160/1000
10/10 [==============================] - 0s - loss: 0.4664
Epoch 161/1000
10/10 [==============================] - 0s - loss: 0.3848
Epoch 162/1000
10/10 [==============================] - 0s - loss: 0.3665
Epoch 163/1000
10/10 [==============================] - 0s - loss: 0.4068
Epoch 164/1000
10/10 [==============================] - 0s - loss: 0.4276
Epoch 165/1000
10/10 [==============================] - 0s - loss: 0.4120
Epoch 166/1000
10/10 [==============================] - 0s - loss: 0.3608
Epoch 167/1000
10/10 [==============================] - 0s - loss: 0.4714
Epoch 168/1000
10/10 [==============================] - 0s - loss: 0.3568
Epoch 169/1000
10/10 [==============================] - 0s - loss: 0.4193
Epoch 170/1000
10/10 [==============================] - 0s - loss: 0.4535
Epoch 171/1000
10/10 [==============================] - 0s - loss: 0.4236
Epoch 172/1000
10/10 [==============================] - 0s - loss: 0.5248
Epoch 173/1000
10/10 [==============================] - 0s - loss: 0.4148
Epoch 174/1000
10/10 [==============================] - 0s - loss: 0.3505
Epoch 175/1000
10/10 [==============================] - 0s - loss: 0.3607
Epoch 176/1000
10/10 [==============================] - 0s - loss: 0.3725
Epoch 177/1000
10/10 [==============================] - 0s - loss: 0.4185
Epoch 178/1000
10/10 [==============================] - 0s - loss: 0.4172
Epoch 179/1000
10/10 [==============================] - 0s - loss: 0.4319
Epoch 180/1000
10/10 [==============================] - 0s - loss: 0.4282
Epoch 181/1000
10/10 [==============================] - 0s - loss: 0.3611
Epoch 182/1000
10/10 [==============================] - 0s - loss: 0.4569
Epoch 183/1000
10/10 [==============================] - 0s - loss: 0.3657
Epoch 184/1000
10/10 [==============================] - 0s - loss: 0.4077
Epoch 185/1000
10/10 [==============================] - 0s - loss: 0.3555
Epoch 186/1000
10/10 [==============================] - 0s - loss: 0.3761
Epoch 187/1000
10/10 [==============================] - 0s - loss: 0.3806
Epoch 188/1000
10/10 [==============================] - 0s - loss: 0.3944
Epoch 189/1000
10/10 [==============================] - 0s - loss: 0.4046
Epoch 190/1000
10/10 [==============================] - 0s - loss: 0.3717
Epoch 191/1000
10/10 [==============================] - 0s - loss: 0.4237
Epoch 192/1000
10/10 [==============================] - 0s - loss: 0.3778
Epoch 193/1000
10/10 [==============================] - 0s - loss: 0.3931
Epoch 194/1000
10/10 [==============================] - 0s - loss: 0.3880
Epoch 195/1000
10/10 [==============================] - 0s - loss: 0.4569
Epoch 196/1000
10/10 [==============================] - 0s - loss: 0.3253
Epoch 197/1000
10/10 [==============================] - 0s - loss: 0.4156
Epoch 198/1000
10/10 [==============================] - 0s - loss: 0.4373
Epoch 199/1000
10/10 [==============================] - 0s - loss: 0.4214
Epoch 200/1000
10/10 [==============================] - 0s - loss: 0.4100
Epoch 201/1000
10/10 [==============================] - 0s - loss: 0.3665
Epoch 202/1000
10/10 [==============================] - 0s - loss: 0.3607
Epoch 203/1000
10/10 [==============================] - 0s - loss: 0.4301
Epoch 204/1000
10/10 [==============================] - 0s - loss: 0.3761
Epoch 205/1000
10/10 [==============================] - 0s - loss: 0.4302
Epoch 206/1000
10/10 [==============================] - 0s - loss: 0.4285
Epoch 207/1000
10/10 [==============================] - 0s - loss: 0.3791
Epoch 208/1000
10/10 [==============================] - 0s - loss: 0.4325
Epoch 209/1000
10/10 [==============================] - 0s - loss: 0.3369
Epoch 210/1000
10/10 [==============================] - 0s - loss: 0.3444
Epoch 211/1000
10/10 [==============================] - 0s - loss: 0.2980
Epoch 212/1000
10/10 [==============================] - 0s - loss: 0.3890
Epoch 213/1000
10/10 [==============================] - 0s - loss: 0.3460
Epoch 214/1000
10/10 [==============================] - 0s - loss: 0.3144
Epoch 215/1000
10/10 [==============================] - 0s - loss: 0.3670
Epoch 216/1000
10/10 [==============================] - 0s - loss: 0.3655
Epoch 217/1000
10/10 [==============================] - 0s - loss: 0.3462
Epoch 218/1000
10/10 [==============================] - 0s - loss: 0.4324
Epoch 219/1000
10/10 [==============================] - 0s - loss: 0.4407
Epoch 220/1000
10/10 [==============================] - 0s - loss: 0.4118
Epoch 221/1000
10/10 [==============================] - 0s - loss: 0.3396
Epoch 222/1000
10/10 [==============================] - 0s - loss: 0.4250
Epoch 223/1000
10/10 [==============================] - 0s - loss: 0.3513
Epoch 224/1000
10/10 [==============================] - 0s - loss: 0.4539
Epoch 225/1000
10/10 [==============================] - 0s - loss: 0.4064
Epoch 226/1000
10/10 [==============================] - 0s - loss: 0.3625
Epoch 227/1000
10/10 [==============================] - 0s - loss: 0.4184
Epoch 228/1000
10/10 [==============================] - 0s - loss: 0.3726
Epoch 229/1000
10/10 [==============================] - 0s - loss: 0.3305
Epoch 230/1000
10/10 [==============================] - 0s - loss: 0.3798
Epoch 231/1000
10/10 [==============================] - 0s - loss: 0.3267
Epoch 232/1000
10/10 [==============================] - 0s - loss: 0.3971
Epoch 233/1000
10/10 [==============================] - 0s - loss: 0.3470
Epoch 234/1000
10/10 [==============================] - 0s - loss: 0.3733
Epoch 235/1000
10/10 [==============================] - 0s - loss: 0.3557
Epoch 236/1000
10/10 [==============================] - 0s - loss: 0.3828
Epoch 237/1000
10/10 [==============================] - 0s - loss: 0.4280
Epoch 238/1000
10/10 [==============================] - 0s - loss: 0.3671
Epoch 239/1000
10/10 [==============================] - 0s - loss: 0.3607
Epoch 240/1000
10/10 [==============================] - 0s - loss: 0.3393
Epoch 241/1000
10/10 [==============================] - 0s - loss: 0.3239
Epoch 242/1000
10/10 [==============================] - 0s - loss: 0.3965
Epoch 243/1000
10/10 [==============================] - 0s - loss: 0.3317
Epoch 244/1000
10/10 [==============================] - 0s - loss: 0.4253
Epoch 245/1000
10/10 [==============================] - 0s - loss: 0.4187
Epoch 246/1000
10/10 [==============================] - 0s - loss: 0.3562
Epoch 247/1000
10/10 [==============================] - 0s - loss: 0.4100
Epoch 248/1000
10/10 [==============================] - 0s - loss: 0.3739
Epoch 249/1000
10/10 [==============================] - 0s - loss: 0.3374
Epoch 250/1000
10/10 [==============================] - 0s - loss: 0.3745
Epoch 251/1000
10/10 [==============================] - 0s - loss: 0.3621
Epoch 252/1000
10/10 [==============================] - 0s - loss: 0.4220
Epoch 253/1000
10/10 [==============================] - 0s - loss: 0.4158
Epoch 254/1000
10/10 [==============================] - 0s - loss: 0.3533
Epoch 255/1000
10/10 [==============================] - 0s - loss: 0.3556
Epoch 256/1000
10/10 [==============================] - 0s - loss: 0.3740
Epoch 257/1000
10/10 [==============================] - 0s - loss: 0.3732
Epoch 258/1000
10/10 [==============================] - 0s - loss: 0.4582
Epoch 259/1000
10/10 [==============================] - 0s - loss: 0.4297
Epoch 260/1000
10/10 [==============================] - 0s - loss: 0.3317
Epoch 261/1000
10/10 [==============================] - 0s - loss: 0.3201
Epoch 262/1000
10/10 [==============================] - 0s - loss: 0.3494
Epoch 263/1000
10/10 [==============================] - 0s - loss: 0.3632
Epoch 264/1000
10/10 [==============================] - 0s - loss: 0.3882
Epoch 265/1000
10/10 [==============================] - 0s - loss: 0.3221
Epoch 266/1000
10/10 [==============================] - 0s - loss: 0.3854
Epoch 267/1000
10/10 [==============================] - 0s - loss: 0.3750
Epoch 268/1000
10/10 [==============================] - 0s - loss: 0.4077
Epoch 269/1000
10/10 [==============================] - 0s - loss: 0.3522
Epoch 270/1000
10/10 [==============================] - 0s - loss: 0.3550
Epoch 271/1000
10/10 [==============================] - 0s - loss: 0.3959
Epoch 272/1000
10/10 [==============================] - 0s - loss: 0.3509
Epoch 273/1000
10/10 [==============================] - 0s - loss: 0.3268
Epoch 274/1000
10/10 [==============================] - 0s - loss: 0.3617
Epoch 275/1000
10/10 [==============================] - 0s - loss: 0.3577
Epoch 276/1000
10/10 [==============================] - 0s - loss: 0.3472
Epoch 277/1000
10/10 [==============================] - 0s - loss: 0.3508
Epoch 278/1000
10/10 [==============================] - 0s - loss: 0.3779
Epoch 279/1000
10/10 [==============================] - 0s - loss: 0.3107
Epoch 280/1000
10/10 [==============================] - 0s - loss: 0.3592
Epoch 281/1000
10/10 [==============================] - 0s - loss: 0.3708
Epoch 282/1000
10/10 [==============================] - 0s - loss: 0.3482
Epoch 283/1000
10/10 [==============================] - 0s - loss: 0.3369
Epoch 284/1000
10/10 [==============================] - 0s - loss: 0.3420
Epoch 285/1000
10/10 [==============================] - 0s - loss: 0.3292
Epoch 286/1000
10/10 [==============================] - 0s - loss: 0.3691
Epoch 287/1000
10/10 [==============================] - 0s - loss: 0.4052
Epoch 288/1000
10/10 [==============================] - 0s - loss: 0.3933
Epoch 289/1000
10/10 [==============================] - 0s - loss: 0.4079
Epoch 290/1000
10/10 [==============================] - 0s - loss: 0.3236
Epoch 291/1000
10/10 [==============================] - 0s - loss: 0.3579
Epoch 292/1000
10/10 [==============================] - 0s - loss: 0.3362
Epoch 293/1000
10/10 [==============================] - 0s - loss: 0.3381
Epoch 294/1000
10/10 [==============================] - 0s - loss: 0.3067
Epoch 295/1000
10/10 [==============================] - 0s - loss: 0.3000
Epoch 296/1000
10/10 [==============================] - 0s - loss: 0.3696
Epoch 297/1000
10/10 [==============================] - 0s - loss: 0.4014
Epoch 298/1000
10/10 [==============================] - 0s - loss: 0.3304
Epoch 299/1000
10/10 [==============================] - 0s - loss: 0.3743
Epoch 300/1000
10/10 [==============================] - 0s - loss: 0.3190
Epoch 301/1000
10/10 [==============================] - 0s - loss: 0.3831
Epoch 302/1000
10/10 [==============================] - 0s - loss: 0.3444
Epoch 303/1000
10/10 [==============================] - 0s - loss: 0.3600
Epoch 304/1000
10/10 [==============================] - 0s - loss: 0.3545
Epoch 305/1000
10/10 [==============================] - 0s - loss: 0.3180
Epoch 306/1000
10/10 [==============================] - 0s - loss: 0.3245
Epoch 307/1000
10/10 [==============================] - 0s - loss: 0.3271
Epoch 308/1000
10/10 [==============================] - 0s - loss: 0.3813
Epoch 309/1000
10/10 [==============================] - 0s - loss: 0.3485
Epoch 310/1000
10/10 [==============================] - 0s - loss: 0.4109
Epoch 311/1000
10/10 [==============================] - 0s - loss: 0.3600
Epoch 312/1000
10/10 [==============================] - 0s - loss: 0.3262
Epoch 313/1000
10/10 [==============================] - 0s - loss: 0.2917
Epoch 314/1000
10/10 [==============================] - 0s - loss: 0.3475
Epoch 315/1000
10/10 [==============================] - 0s - loss: 0.2997
Epoch 316/1000
10/10 [==============================] - 0s - loss: 0.3190
Epoch 317/1000
10/10 [==============================] - 0s - loss: 0.3561
Epoch 318/1000
10/10 [==============================] - 0s - loss: 0.3257
Epoch 319/1000
10/10 [==============================] - 0s - loss: 0.3589
Epoch 320/1000
10/10 [==============================] - 0s - loss: 0.3301
Epoch 321/1000
10/10 [==============================] - 0s - loss: 0.3711
Epoch 322/1000
10/10 [==============================] - 0s - loss: 0.3548
Epoch 323/1000
10/10 [==============================] - 0s - loss: 0.3634
Epoch 324/1000
10/10 [==============================] - 0s - loss: 0.3476
Epoch 325/1000
10/10 [==============================] - 0s - loss: 0.3312
Epoch 326/1000
10/10 [==============================] - 0s - loss: 0.3681
Epoch 327/1000
10/10 [==============================] - 0s - loss: 0.3738
Epoch 328/1000
10/10 [==============================] - 0s - loss: 0.3450
Epoch 329/1000
10/10 [==============================] - 0s - loss: 0.3186
Epoch 330/1000
10/10 [==============================] - 0s - loss: 0.3066
Epoch 331/1000
10/10 [==============================] - 0s - loss: 0.2890
Epoch 332/1000
10/10 [==============================] - 0s - loss: 0.3318
Epoch 333/1000
10/10 [==============================] - 0s - loss: 0.3412
Epoch 334/1000
10/10 [==============================] - 0s - loss: 0.3582
Epoch 335/1000
10/10 [==============================] - 0s - loss: 0.3492
Epoch 336/1000
10/10 [==============================] - 0s - loss: 0.3094
Epoch 337/1000
10/10 [==============================] - 0s - loss: 0.3264
Epoch 338/1000
10/10 [==============================] - 0s - loss: 0.3148
Epoch 339/1000
10/10 [==============================] - 0s - loss: 0.3607
Epoch 340/1000
10/10 [==============================] - 0s - loss: 0.3351
Epoch 341/1000
10/10 [==============================] - 0s - loss: 0.3155
Epoch 342/1000
10/10 [==============================] - 0s - loss: 0.3563
Epoch 343/1000
10/10 [==============================] - 0s - loss: 0.3557
Epoch 344/1000
10/10 [==============================] - 0s - loss: 0.3245
Epoch 345/1000
10/10 [==============================] - 0s - loss: 0.3074
Epoch 346/1000
10/10 [==============================] - 0s - loss: 0.3319
Epoch 347/1000
10/10 [==============================] - 0s - loss: 0.3225
Epoch 348/1000
10/10 [==============================] - 0s - loss: 0.2784
Epoch 349/1000
10/10 [==============================] - 0s - loss: 0.3252
Epoch 350/1000
10/10 [==============================] - 0s - loss: 0.3618
Epoch 351/1000
10/10 [==============================] - 0s - loss: 0.3224
Epoch 352/1000
10/10 [==============================] - 0s - loss: 0.3371
Epoch 353/1000
10/10 [==============================] - 0s - loss: 0.3756
Epoch 354/1000
10/10 [==============================] - 0s - loss: 0.3498
Epoch 355/1000
10/10 [==============================] - 0s - loss: 0.2743
Epoch 356/1000
10/10 [==============================] - 0s - loss: 0.3915
Epoch 357/1000
10/10 [==============================] - 0s - loss: 0.3907
Epoch 358/1000
10/10 [==============================] - 0s - loss: 0.3155
Epoch 359/1000
10/10 [==============================] - 0s - loss: 0.3077
Epoch 360/1000
10/10 [==============================] - 0s - loss: 0.3004
Epoch 361/1000
10/10 [==============================] - 0s - loss: 0.3579
Epoch 362/1000
10/10 [==============================] - 0s - loss: 0.3744
Epoch 363/1000
10/10 [==============================] - 0s - loss: 0.2999
Epoch 364/1000
10/10 [==============================] - 0s - loss: 0.3145
Epoch 365/1000
10/10 [==============================] - 0s - loss: 0.3887
Epoch 366/1000
10/10 [==============================] - 0s - loss: 0.3034
Epoch 367/1000
10/10 [==============================] - 0s - loss: 0.3191
Epoch 368/1000
10/10 [==============================] - 0s - loss: 0.3401
Epoch 369/1000
10/10 [==============================] - 0s - loss: 0.3345
Epoch 370/1000
10/10 [==============================] - 0s - loss: 0.3055
Epoch 371/1000
10/10 [==============================] - 0s - loss: 0.3420
Epoch 372/1000
10/10 [==============================] - 0s - loss: 0.3557
Epoch 373/1000
10/10 [==============================] - 0s - loss: 0.3393
Epoch 374/1000
10/10 [==============================] - 0s - loss: 0.2772
Epoch 375/1000
10/10 [==============================] - 0s - loss: 0.2772
Epoch 376/1000
10/10 [==============================] - 0s - loss: 0.3189
Epoch 377/1000
10/10 [==============================] - 0s - loss: 0.3110
Epoch 378/1000
10/10 [==============================] - 0s - loss: 0.2921
Epoch 379/1000
10/10 [==============================] - 0s - loss: 0.3831
Epoch 380/1000
10/10 [==============================] - 0s - loss: 0.3140
Epoch 381/1000
10/10 [==============================] - 0s - loss: 0.3132
Epoch 382/1000
10/10 [==============================] - 0s - loss: 0.3077
Epoch 383/1000
10/10 [==============================] - 0s - loss: 0.3712
Epoch 384/1000
10/10 [==============================] - 0s - loss: 0.3202
Epoch 385/1000
10/10 [==============================] - 0s - loss: 0.3424
Epoch 386/1000
10/10 [==============================] - 0s - loss: 0.3497
Epoch 387/1000
10/10 [==============================] - 0s - loss: 0.3078
Epoch 388/1000
10/10 [==============================] - 0s - loss: 0.3118
Epoch 389/1000
10/10 [==============================] - 0s - loss: 0.3107
Epoch 390/1000
10/10 [==============================] - 0s - loss: 0.3984
Epoch 391/1000
10/10 [==============================] - 0s - loss: 0.3388
Epoch 392/1000
10/10 [==============================] - 0s - loss: 0.2741
Epoch 393/1000
10/10 [==============================] - 0s - loss: 0.2987
Epoch 394/1000
10/10 [==============================] - 0s - loss: 0.3448
Epoch 395/1000
10/10 [==============================] - 0s - loss: 0.3023
Epoch 396/1000
10/10 [==============================] - 0s - loss: 0.3212
Epoch 397/1000
10/10 [==============================] - 0s - loss: 0.2664
Epoch 398/1000
10/10 [==============================] - 0s - loss: 0.3615
Epoch 399/1000
10/10 [==============================] - 0s - loss: 0.3214
Epoch 400/1000
10/10 [==============================] - 0s - loss: 0.3569
Epoch 401/1000
10/10 [==============================] - 0s - loss: 0.3193
Epoch 402/1000
10/10 [==============================] - 0s - loss: 0.2901
Epoch 403/1000
10/10 [==============================] - 0s - loss: 0.2860
Epoch 404/1000
10/10 [==============================] - 0s - loss: 0.2861
Epoch 405/1000
10/10 [==============================] - 0s - loss: 0.2788
Epoch 406/1000
10/10 [==============================] - 0s - loss: 0.3617
Epoch 407/1000
10/10 [==============================] - 0s - loss: 0.2866
Epoch 408/1000
10/10 [==============================] - 0s - loss: 0.3778
Epoch 409/1000
10/10 [==============================] - 0s - loss: 0.2965
Epoch 410/1000
10/10 [==============================] - 0s - loss: 0.3004
Epoch 411/1000
10/10 [==============================] - 0s - loss: 0.3226
Epoch 412/1000
10/10 [==============================] - 0s - loss: 0.3224
Epoch 413/1000
10/10 [==============================] - 0s - loss: 0.2717
Epoch 414/1000
10/10 [==============================] - 0s - loss: 0.3591
Epoch 415/1000
10/10 [==============================] - 0s - loss: 0.3627
Epoch 416/1000
10/10 [==============================] - 0s - loss: 0.3256
Epoch 417/1000
10/10 [==============================] - 0s - loss: 0.2874
Epoch 418/1000
10/10 [==============================] - 0s - loss: 0.2894
Epoch 419/1000
10/10 [==============================] - 0s - loss: 0.3144
Epoch 420/1000
10/10 [==============================] - 0s - loss: 0.2991
Epoch 421/1000
10/10 [==============================] - 0s - loss: 0.3362
Epoch 422/1000
10/10 [==============================] - 0s - loss: 0.3387
Epoch 423/1000
10/10 [==============================] - 0s - loss: 0.3074
Epoch 424/1000
10/10 [==============================] - 0s - loss: 0.2884
Epoch 425/1000
10/10 [==============================] - 0s - loss: 0.2899
Epoch 426/1000
10/10 [==============================] - 0s - loss: 0.2852
Epoch 427/1000
10/10 [==============================] - 0s - loss: 0.3345
Epoch 428/1000
10/10 [==============================] - 0s - loss: 0.3277
Epoch 429/1000
10/10 [==============================] - 0s - loss: 0.3181
Epoch 430/1000
10/10 [==============================] - 0s - loss: 0.3336
Epoch 431/1000
10/10 [==============================] - 0s - loss: 0.3263
Epoch 432/1000
10/10 [==============================] - 0s - loss: 0.3891
Epoch 433/1000
10/10 [==============================] - 0s - loss: 0.3240
Epoch 434/1000
10/10 [==============================] - 0s - loss: 0.3281
Epoch 435/1000
10/10 [==============================] - 0s - loss: 0.3269
Epoch 436/1000
10/10 [==============================] - 0s - loss: 0.3700
Epoch 437/1000
10/10 [==============================] - 0s - loss: 0.3157
Epoch 438/1000
10/10 [==============================] - 0s - loss: 0.3123
Epoch 439/1000
10/10 [==============================] - 0s - loss: 0.2729
Epoch 440/1000
10/10 [==============================] - 0s - loss: 0.3048
Epoch 441/1000
10/10 [==============================] - 0s - loss: 0.2528
Epoch 442/1000
10/10 [==============================] - 0s - loss: 0.3465
Epoch 443/1000
10/10 [==============================] - 0s - loss: 0.3194
Epoch 444/1000
10/10 [==============================] - 0s - loss: 0.2854
Epoch 445/1000
10/10 [==============================] - 0s - loss: 0.3453
Epoch 446/1000
10/10 [==============================] - 0s - loss: 0.2891
Epoch 447/1000
10/10 [==============================] - 0s - loss: 0.2811
Epoch 448/1000
10/10 [==============================] - 0s - loss: 0.3301
Epoch 449/1000
10/10 [==============================] - 0s - loss: 0.2954
Epoch 450/1000
10/10 [==============================] - 0s - loss: 0.2694
Epoch 451/1000
10/10 [==============================] - 0s - loss: 0.2907
Epoch 452/1000
10/10 [==============================] - 0s - loss: 0.2952
Epoch 453/1000
10/10 [==============================] - 0s - loss: 0.3053
Epoch 454/1000
10/10 [==============================] - 0s - loss: 0.3400
Epoch 455/1000
10/10 [==============================] - 0s - loss: 0.2876
Epoch 456/1000
10/10 [==============================] - 0s - loss: 0.2603
Epoch 457/1000
10/10 [==============================] - 0s - loss: 0.3282
Epoch 458/1000
10/10 [==============================] - 0s - loss: 0.2957
Epoch 459/1000
10/10 [==============================] - 0s - loss: 0.3059
Epoch 460/1000
10/10 [==============================] - 0s - loss: 0.3048
Epoch 461/1000
10/10 [==============================] - 0s - loss: 0.2887
Epoch 462/1000
10/10 [==============================] - 0s - loss: 0.3070
Epoch 463/1000
10/10 [==============================] - 0s - loss: 0.3560
Epoch 464/1000
10/10 [==============================] - 0s - loss: 0.3428
Epoch 465/1000
10/10 [==============================] - 0s - loss: 0.2848
Epoch 466/1000
10/10 [==============================] - 0s - loss: 0.3285
Epoch 467/1000
10/10 [==============================] - 0s - loss: 0.2766
Epoch 468/1000
10/10 [==============================] - 0s - loss: 0.3419
Epoch 469/1000
10/10 [==============================] - 0s - loss: 0.2906
Epoch 470/1000
10/10 [==============================] - 0s - loss: 0.3304
Epoch 471/1000
10/10 [==============================] - 0s - loss: 0.3382
Epoch 472/1000
10/10 [==============================] - 0s - loss: 0.3207
Epoch 473/1000
10/10 [==============================] - 0s - loss: 0.3280
Epoch 474/1000
10/10 [==============================] - 0s - loss: 0.2556
Epoch 475/1000
10/10 [==============================] - 0s - loss: 0.2967
Epoch 476/1000
10/10 [==============================] - 0s - loss: 0.3311
Epoch 477/1000
10/10 [==============================] - 0s - loss: 0.2880
Epoch 478/1000
10/10 [==============================] - 0s - loss: 0.3085
Epoch 479/1000
10/10 [==============================] - 0s - loss: 0.3085
Epoch 480/1000
10/10 [==============================] - 0s - loss: 0.3065
Epoch 481/1000
10/10 [==============================] - 0s - loss: 0.3295
Epoch 482/1000
10/10 [==============================] - 0s - loss: 0.2935
Epoch 483/1000
10/10 [==============================] - 0s - loss: 0.3018
Epoch 484/1000
10/10 [==============================] - 0s - loss: 0.3125
Epoch 485/1000
10/10 [==============================] - 0s - loss: 0.2792
Epoch 486/1000
10/10 [==============================] - 0s - loss: 0.3088
Epoch 487/1000
10/10 [==============================] - 0s - loss: 0.2896
Epoch 488/1000
10/10 [==============================] - 0s - loss: 0.3028
Epoch 489/1000
10/10 [==============================] - 0s - loss: 0.2857
Epoch 490/1000
10/10 [==============================] - 0s - loss: 0.2969
Epoch 491/1000
10/10 [==============================] - 0s - loss: 0.3647
Epoch 492/1000
10/10 [==============================] - 0s - loss: 0.2763
Epoch 493/1000
10/10 [==============================] - 0s - loss: 0.3029
Epoch 494/1000
10/10 [==============================] - 0s - loss: 0.2941
Epoch 495/1000
10/10 [==============================] - 0s - loss: 0.2713
Epoch 496/1000
10/10 [==============================] - 0s - loss: 0.3032
Epoch 497/1000
10/10 [==============================] - 0s - loss: 0.2721
Epoch 498/1000
10/10 [==============================] - 0s - loss: 0.3744
Epoch 499/1000
10/10 [==============================] - 0s - loss: 0.3044
Epoch 500/1000
10/10 [==============================] - 0s - loss: 0.3040
Epoch 501/1000
10/10 [==============================] - 0s - loss: 0.2643
Epoch 502/1000
10/10 [==============================] - 0s - loss: 0.2621
Epoch 503/1000
10/10 [==============================] - 0s - loss: 0.2424
Epoch 504/1000
10/10 [==============================] - 0s - loss: 0.2720
Epoch 505/1000
10/10 [==============================] - 0s - loss: 0.2783
Epoch 506/1000
10/10 [==============================] - 0s - loss: 0.3160
Epoch 507/1000
10/10 [==============================] - 0s - loss: 0.2992
Epoch 508/1000
10/10 [==============================] - 0s - loss: 0.2972
Epoch 509/1000
10/10 [==============================] - 0s - loss: 0.3240
Epoch 510/1000
10/10 [==============================] - 0s - loss: 0.2915
Epoch 511/1000
10/10 [==============================] - 0s - loss: 0.3293
Epoch 512/1000
10/10 [==============================] - 0s - loss: 0.2433
Epoch 513/1000
10/10 [==============================] - 0s - loss: 0.3032
Epoch 514/1000
10/10 [==============================] - 0s - loss: 0.2757
Epoch 515/1000
10/10 [==============================] - 0s - loss: 0.2854
Epoch 516/1000
10/10 [==============================] - 0s - loss: 0.3579
Epoch 517/1000
10/10 [==============================] - 0s - loss: 0.2736
Epoch 518/1000
10/10 [==============================] - 0s - loss: 0.3074
Epoch 519/1000
10/10 [==============================] - 0s - loss: 0.3118
Epoch 520/1000
10/10 [==============================] - 0s - loss: 0.2725
Epoch 521/1000
10/10 [==============================] - 0s - loss: 0.2983
Epoch 522/1000
10/10 [==============================] - 0s - loss: 0.3109
Epoch 523/1000
10/10 [==============================] - 0s - loss: 0.2744
Epoch 524/1000
10/10 [==============================] - 0s - loss: 0.2567
Epoch 525/1000
10/10 [==============================] - 0s - loss: 0.2812
Epoch 526/1000
10/10 [==============================] - 0s - loss: 0.2630
Epoch 527/1000
10/10 [==============================] - 0s - loss: 0.3139
Epoch 528/1000
10/10 [==============================] - 0s - loss: 0.2863
Epoch 529/1000
10/10 [==============================] - 0s - loss: 0.3116
Epoch 530/1000
10/10 [==============================] - 0s - loss: 0.3033
Epoch 531/1000
10/10 [==============================] - 0s - loss: 0.2931
Epoch 532/1000
10/10 [==============================] - 0s - loss: 0.2661
Epoch 533/1000
10/10 [==============================] - 0s - loss: 0.2955
Epoch 534/1000
10/10 [==============================] - 0s - loss: 0.2998
Epoch 535/1000
10/10 [==============================] - 0s - loss: 0.2651
Epoch 536/1000
10/10 [==============================] - 0s - loss: 0.2867
Epoch 537/1000
10/10 [==============================] - 0s - loss: 0.2918
Epoch 538/1000
10/10 [==============================] - 0s - loss: 0.2499
Epoch 539/1000
10/10 [==============================] - 0s - loss: 0.2427
Epoch 540/1000
10/10 [==============================] - 0s - loss: 0.2741
Epoch 541/1000
10/10 [==============================] - 0s - loss: 0.3320
Epoch 542/1000
10/10 [==============================] - 0s - loss: 0.2757
Epoch 543/1000
10/10 [==============================] - 0s - loss: 0.2710
Epoch 544/1000
10/10 [==============================] - 0s - loss: 0.3271
Epoch 545/1000
10/10 [==============================] - 0s - loss: 0.3111
Epoch 546/1000
10/10 [==============================] - 0s - loss: 0.2907
Epoch 547/1000
10/10 [==============================] - 0s - loss: 0.3227
Epoch 548/1000
10/10 [==============================] - 0s - loss: 0.2635
Epoch 549/1000
10/10 [==============================] - 0s - loss: 0.2966
Epoch 550/1000
10/10 [==============================] - 0s - loss: 0.2847
Epoch 551/1000
10/10 [==============================] - 0s - loss: 0.3243
Epoch 552/1000
10/10 [==============================] - 0s - loss: 0.2765
Epoch 553/1000
10/10 [==============================] - 0s - loss: 0.2765
Epoch 554/1000
10/10 [==============================] - 0s - loss: 0.2572
Epoch 555/1000
10/10 [==============================] - 0s - loss: 0.2765
Epoch 556/1000
10/10 [==============================] - 0s - loss: 0.3052
Epoch 557/1000
10/10 [==============================] - 0s - loss: 0.2794
Epoch 558/1000
10/10 [==============================] - 0s - loss: 0.2891
Epoch 559/1000
10/10 [==============================] - 0s - loss: 0.2990
Epoch 560/1000
10/10 [==============================] - 0s - loss: 0.2365
Epoch 561/1000
10/10 [==============================] - 0s - loss: 0.2535
Epoch 562/1000
10/10 [==============================] - 0s - loss: 0.3061
Epoch 563/1000
10/10 [==============================] - 0s - loss: 0.2738
Epoch 564/1000
10/10 [==============================] - 0s - loss: 0.2313
Epoch 565/1000
10/10 [==============================] - 0s - loss: 0.2657
Epoch 566/1000
10/10 [==============================] - 0s - loss: 0.2860
Epoch 567/1000
10/10 [==============================] - 0s - loss: 0.3446
Epoch 568/1000
10/10 [==============================] - 0s - loss: 0.3529
Epoch 569/1000
10/10 [==============================] - 0s - loss: 0.2743
Epoch 570/1000
10/10 [==============================] - 0s - loss: 0.3044
Epoch 571/1000
10/10 [==============================] - 0s - loss: 0.3200
Epoch 572/1000
10/10 [==============================] - 0s - loss: 0.2856
Epoch 573/1000
10/10 [==============================] - 0s - loss: 0.2589
Epoch 574/1000
10/10 [==============================] - 0s - loss: 0.2755
Epoch 575/1000
10/10 [==============================] - 0s - loss: 0.2818
Epoch 576/1000
10/10 [==============================] - 0s - loss: 0.2917
Epoch 577/1000
10/10 [==============================] - 0s - loss: 0.2674
Epoch 578/1000
10/10 [==============================] - 0s - loss: 0.2884
Epoch 579/1000
10/10 [==============================] - 0s - loss: 0.2847
Epoch 580/1000
10/10 [==============================] - 0s - loss: 0.2416
Epoch 581/1000
10/10 [==============================] - 0s - loss: 0.3151
Epoch 582/1000
10/10 [==============================] - 0s - loss: 0.2311
Epoch 583/1000
10/10 [==============================] - 0s - loss: 0.2665
Epoch 584/1000
10/10 [==============================] - 0s - loss: 0.2520
Epoch 585/1000
10/10 [==============================] - 0s - loss: 0.2605
Epoch 586/1000
10/10 [==============================] - 0s - loss: 0.3125
Epoch 587/1000
10/10 [==============================] - 0s - loss: 0.2936
Epoch 588/1000
10/10 [==============================] - 0s - loss: 0.2762
Epoch 589/1000
10/10 [==============================] - 0s - loss: 0.2619
Epoch 590/1000
10/10 [==============================] - 0s - loss: 0.3146
Epoch 591/1000
10/10 [==============================] - 0s - loss: 0.2901
Epoch 592/1000
10/10 [==============================] - 0s - loss: 0.2808
Epoch 593/1000
10/10 [==============================] - 0s - loss: 0.2740
Epoch 594/1000
10/10 [==============================] - 0s - loss: 0.3016
Epoch 595/1000
10/10 [==============================] - 0s - loss: 0.2797
Epoch 596/1000
10/10 [==============================] - 0s - loss: 0.2896
Epoch 597/1000
10/10 [==============================] - 0s - loss: 0.2515
Epoch 598/1000
10/10 [==============================] - 0s - loss: 0.3079
Epoch 599/1000
10/10 [==============================] - 0s - loss: 0.3044
Epoch 600/1000
10/10 [==============================] - 0s - loss: 0.2716
Epoch 601/1000
10/10 [==============================] - 0s - loss: 0.2657
Epoch 602/1000
10/10 [==============================] - 0s - loss: 0.3078
Epoch 603/1000
10/10 [==============================] - 0s - loss: 0.2600
Epoch 604/1000
10/10 [==============================] - 0s - loss: 0.2412
Epoch 605/1000
10/10 [==============================] - 0s - loss: 0.2308
Epoch 606/1000
10/10 [==============================] - 0s - loss: 0.2302
Epoch 607/1000
10/10 [==============================] - 0s - loss: 0.2713
Epoch 608/1000
10/10 [==============================] - 0s - loss: 0.2813
Epoch 609/1000
10/10 [==============================] - 0s - loss: 0.2346
Epoch 610/1000
10/10 [==============================] - 0s - loss: 0.2518
Epoch 611/1000
10/10 [==============================] - 0s - loss: 0.2614
Epoch 612/1000
10/10 [==============================] - 0s - loss: 0.2843
Epoch 613/1000
10/10 [==============================] - 0s - loss: 0.2990
Epoch 614/1000
10/10 [==============================] - 0s - loss: 0.2518
Epoch 615/1000
10/10 [==============================] - 0s - loss: 0.2614
Epoch 616/1000
10/10 [==============================] - 0s - loss: 0.2677
Epoch 617/1000
10/10 [==============================] - 0s - loss: 0.3084
Epoch 618/1000
10/10 [==============================] - 0s - loss: 0.2634
Epoch 619/1000
10/10 [==============================] - 0s - loss: 0.2635
Epoch 620/1000
10/10 [==============================] - 0s - loss: 0.2902
Epoch 621/1000
10/10 [==============================] - 0s - loss: 0.2360
Epoch 622/1000
10/10 [==============================] - 0s - loss: 0.2756
Epoch 623/1000
10/10 [==============================] - 0s - loss: 0.2358
Epoch 624/1000
10/10 [==============================] - 0s - loss: 0.2622
Epoch 625/1000
10/10 [==============================] - 0s - loss: 0.2487
Epoch 626/1000
10/10 [==============================] - 0s - loss: 0.2390
Epoch 627/1000
10/10 [==============================] - 0s - loss: 0.2936
Epoch 628/1000
10/10 [==============================] - 0s - loss: 0.2568
Epoch 629/1000
10/10 [==============================] - 0s - loss: 0.2760
Epoch 630/1000
10/10 [==============================] - 0s - loss: 0.2955
Epoch 631/1000
10/10 [==============================] - 0s - loss: 0.2681
Epoch 632/1000
10/10 [==============================] - 0s - loss: 0.2574
Epoch 633/1000
10/10 [==============================] - 0s - loss: 0.2565
Epoch 634/1000
10/10 [==============================] - 0s - loss: 0.2462
Epoch 635/1000
10/10 [==============================] - 0s - loss: 0.2443
Epoch 636/1000
10/10 [==============================] - 0s - loss: 0.2533
Epoch 637/1000
10/10 [==============================] - 0s - loss: 0.2691
Epoch 638/1000
10/10 [==============================] - 0s - loss: 0.2858
Epoch 639/1000
10/10 [==============================] - 0s - loss: 0.2469
Epoch 640/1000
10/10 [==============================] - 0s - loss: 0.2704
Epoch 641/1000
10/10 [==============================] - 0s - loss: 0.3470
Epoch 642/1000
10/10 [==============================] - 0s - loss: 0.2369
Epoch 643/1000
10/10 [==============================] - 0s - loss: 0.2985
Epoch 644/1000
10/10 [==============================] - 0s - loss: 0.2698
Epoch 645/1000
10/10 [==============================] - 0s - loss: 0.2753
Epoch 646/1000
10/10 [==============================] - 0s - loss: 0.2635
Epoch 647/1000
10/10 [==============================] - 0s - loss: 0.2514
Epoch 648/1000
10/10 [==============================] - 0s - loss: 0.2462
Epoch 649/1000
10/10 [==============================] - 0s - loss: 0.2725
Epoch 650/1000
10/10 [==============================] - 0s - loss: 0.2624
Epoch 651/1000
10/10 [==============================] - 0s - loss: 0.2752
Epoch 652/1000
10/10 [==============================] - 0s - loss: 0.3077
Epoch 653/1000
10/10 [==============================] - 0s - loss: 0.2618
Epoch 654/1000
10/10 [==============================] - 0s - loss: 0.2696
Epoch 655/1000
10/10 [==============================] - 0s - loss: 0.2455
Epoch 656/1000
10/10 [==============================] - 0s - loss: 0.2896
Epoch 657/1000
10/10 [==============================] - 0s - loss: 0.2521
Epoch 658/1000
10/10 [==============================] - 0s - loss: 0.3132
Epoch 659/1000
10/10 [==============================] - 0s - loss: 0.2716
Epoch 660/1000
10/10 [==============================] - 0s - loss: 0.2641
Epoch 661/1000
10/10 [==============================] - 0s - loss: 0.2403
Epoch 662/1000
10/10 [==============================] - 0s - loss: 0.2752
Epoch 663/1000
10/10 [==============================] - 0s - loss: 0.2415
Epoch 664/1000
10/10 [==============================] - 0s - loss: 0.2603
Epoch 665/1000
10/10 [==============================] - 0s - loss: 0.2749
Epoch 666/1000
10/10 [==============================] - 0s - loss: 0.2681
Epoch 667/1000
10/10 [==============================] - 0s - loss: 0.2675
Epoch 668/1000
10/10 [==============================] - 0s - loss: 0.2200
Epoch 669/1000
10/10 [==============================] - 0s - loss: 0.2402
Epoch 670/1000
10/10 [==============================] - 0s - loss: 0.2604
Epoch 671/1000
10/10 [==============================] - 0s - loss: 0.2372
Epoch 672/1000
10/10 [==============================] - 0s - loss: 0.2847
Epoch 673/1000
10/10 [==============================] - 0s - loss: 0.2425
Epoch 674/1000
10/10 [==============================] - 0s - loss: 0.2995
Epoch 675/1000
10/10 [==============================] - 0s - loss: 0.2510
Epoch 676/1000
10/10 [==============================] - 0s - loss: 0.2631
Epoch 677/1000
10/10 [==============================] - 0s - loss: 0.2705
Epoch 678/1000
10/10 [==============================] - 0s - loss: 0.2389
Epoch 679/1000
10/10 [==============================] - 0s - loss: 0.2645
Epoch 680/1000
10/10 [==============================] - 0s - loss: 0.2409
Epoch 681/1000
10/10 [==============================] - 0s - loss: 0.3155
Epoch 682/1000
10/10 [==============================] - 0s - loss: 0.2695
Epoch 683/1000
10/10 [==============================] - 0s - loss: 0.2213
Epoch 684/1000
10/10 [==============================] - 0s - loss: 0.2363
Epoch 685/1000
10/10 [==============================] - 0s - loss: 0.2691
Epoch 686/1000
10/10 [==============================] - 0s - loss: 0.2607
Epoch 687/1000
10/10 [==============================] - 0s - loss: 0.2495
Epoch 688/1000
10/10 [==============================] - 0s - loss: 0.2605
Epoch 689/1000
10/10 [==============================] - 0s - loss: 0.2625
Epoch 690/1000
10/10 [==============================] - 0s - loss: 0.2979
Epoch 691/1000
10/10 [==============================] - 0s - loss: 0.2897
Epoch 692/1000
10/10 [==============================] - 0s - loss: 0.2492
Epoch 693/1000
10/10 [==============================] - 0s - loss: 0.2145
Epoch 694/1000
10/10 [==============================] - 0s - loss: 0.2251
Epoch 695/1000
10/10 [==============================] - 0s - loss: 0.2489
Epoch 696/1000
10/10 [==============================] - 0s - loss: 0.2649
Epoch 697/1000
10/10 [==============================] - 0s - loss: 0.2884
Epoch 698/1000
10/10 [==============================] - 0s - loss: 0.2478
Epoch 699/1000
10/10 [==============================] - 0s - loss: 0.2564
Epoch 700/1000
10/10 [==============================] - 0s - loss: 0.2282
Epoch 701/1000
10/10 [==============================] - 0s - loss: 0.2847
Epoch 702/1000
10/10 [==============================] - 0s - loss: 0.2260
Epoch 703/1000
10/10 [==============================] - 0s - loss: 0.2473
Epoch 704/1000
10/10 [==============================] - 0s - loss: 0.2640
Epoch 705/1000
10/10 [==============================] - 0s - loss: 0.2622
Epoch 706/1000
10/10 [==============================] - 0s - loss: 0.2280
Epoch 707/1000
10/10 [==============================] - 0s - loss: 0.2431
Epoch 708/1000
10/10 [==============================] - 0s - loss: 0.2878
Epoch 709/1000
10/10 [==============================] - 0s - loss: 0.2658
Epoch 710/1000
10/10 [==============================] - 0s - loss: 0.2351
Epoch 711/1000
10/10 [==============================] - 0s - loss: 0.2443
Epoch 712/1000
10/10 [==============================] - 0s - loss: 0.2449
Epoch 713/1000
10/10 [==============================] - 0s - loss: 0.2230
Epoch 714/1000
10/10 [==============================] - 0s - loss: 0.2809
Epoch 715/1000
10/10 [==============================] - 0s - loss: 0.2597
Epoch 716/1000
10/10 [==============================] - 0s - loss: 0.2462
Epoch 717/1000
10/10 [==============================] - 0s - loss: 0.2231
Epoch 718/1000
10/10 [==============================] - 0s - loss: 0.2439
Epoch 719/1000
10/10 [==============================] - 0s - loss: 0.3322
Epoch 720/1000
10/10 [==============================] - 0s - loss: 0.2349
Epoch 721/1000
10/10 [==============================] - 0s - loss: 0.2454
Epoch 722/1000
10/10 [==============================] - 0s - loss: 0.2472
Epoch 723/1000
10/10 [==============================] - 0s - loss: 0.2583
Epoch 724/1000
10/10 [==============================] - 0s - loss: 0.2450
Epoch 725/1000
10/10 [==============================] - 0s - loss: 0.2364
Epoch 726/1000
10/10 [==============================] - 0s - loss: 0.2166
Epoch 727/1000
10/10 [==============================] - 0s - loss: 0.2268
Epoch 728/1000
10/10 [==============================] - 0s - loss: 0.2634
Epoch 729/1000
10/10 [==============================] - 0s - loss: 0.2879
Epoch 730/1000
10/10 [==============================] - 0s - loss: 0.2365
Epoch 731/1000
10/10 [==============================] - 0s - loss: 0.2773
Epoch 732/1000
10/10 [==============================] - 0s - loss: 0.2580
Epoch 733/1000
10/10 [==============================] - 0s - loss: 0.2984
Epoch 734/1000
10/10 [==============================] - 0s - loss: 0.2537
Epoch 735/1000
10/10 [==============================] - 0s - loss: 0.2334
Epoch 736/1000
10/10 [==============================] - 0s - loss: 0.2783
Epoch 737/1000
10/10 [==============================] - 0s - loss: 0.2157
Epoch 738/1000
10/10 [==============================] - 0s - loss: 0.2373
Epoch 739/1000
10/10 [==============================] - 0s - loss: 0.2581
Epoch 740/1000
10/10 [==============================] - 0s - loss: 0.2531
Epoch 741/1000
10/10 [==============================] - 0s - loss: 0.2832
Epoch 742/1000
10/10 [==============================] - 0s - loss: 0.2349
Epoch 743/1000
10/10 [==============================] - 0s - loss: 0.2554
Epoch 744/1000
10/10 [==============================] - 0s - loss: 0.2300
Epoch 745/1000
10/10 [==============================] - 0s - loss: 0.2649
Epoch 746/1000
10/10 [==============================] - 0s - loss: 0.2265
Epoch 747/1000
10/10 [==============================] - 0s - loss: 0.2497
Epoch 748/1000
10/10 [==============================] - 0s - loss: 0.2431
Epoch 749/1000
10/10 [==============================] - 0s - loss: 0.2416
Epoch 750/1000
10/10 [==============================] - 0s - loss: 0.2495
Epoch 751/1000
10/10 [==============================] - 0s - loss: 0.2339
Epoch 752/1000
10/10 [==============================] - 0s - loss: 0.2029
Epoch 753/1000
10/10 [==============================] - 0s - loss: 0.2444
Epoch 754/1000
10/10 [==============================] - 0s - loss: 0.2426
Epoch 755/1000
10/10 [==============================] - 0s - loss: 0.2531
Epoch 756/1000
10/10 [==============================] - 0s - loss: 0.2560
Epoch 757/1000
10/10 [==============================] - 0s - loss: 0.2617
Epoch 758/1000
10/10 [==============================] - 0s - loss: 0.2617
Epoch 759/1000
10/10 [==============================] - 0s - loss: 0.2373
Epoch 760/1000
10/10 [==============================] - 0s - loss: 0.2424
Epoch 761/1000
10/10 [==============================] - 0s - loss: 0.2372
Epoch 762/1000
10/10 [==============================] - 0s - loss: 0.2278
Epoch 763/1000
10/10 [==============================] - 0s - loss: 0.2344
Epoch 764/1000
10/10 [==============================] - 0s - loss: 0.2649
Epoch 765/1000
10/10 [==============================] - 0s - loss: 0.2665
Epoch 766/1000
10/10 [==============================] - 0s - loss: 0.2411
Epoch 767/1000
10/10 [==============================] - 0s - loss: 0.2165
Epoch 768/1000
10/10 [==============================] - 0s - loss: 0.2394
Epoch 769/1000
10/10 [==============================] - 0s - loss: 0.2664
Epoch 770/1000
10/10 [==============================] - 0s - loss: 0.2542
Epoch 771/1000
10/10 [==============================] - 0s - loss: 0.2470
Epoch 772/1000
10/10 [==============================] - 0s - loss: 0.2224
Epoch 773/1000
10/10 [==============================] - 0s - loss: 0.2477
Epoch 774/1000
10/10 [==============================] - 0s - loss: 0.2215
Epoch 775/1000
10/10 [==============================] - 0s - loss: 0.2543
Epoch 776/1000
10/10 [==============================] - 0s - loss: 0.2175
Epoch 777/1000
10/10 [==============================] - 0s - loss: 0.2002
Epoch 778/1000
10/10 [==============================] - 0s - loss: 0.2236
Epoch 779/1000
10/10 [==============================] - 0s - loss: 0.2353
Epoch 780/1000
10/10 [==============================] - 0s - loss: 0.2272
Epoch 781/1000
10/10 [==============================] - 0s - loss: 0.2443
Epoch 782/1000
10/10 [==============================] - 0s - loss: 0.2476
Epoch 783/1000
10/10 [==============================] - 0s - loss: 0.2262
Epoch 784/1000
10/10 [==============================] - 0s - loss: 0.2385
Epoch 785/1000
10/10 [==============================] - 0s - loss: 0.2359
Epoch 786/1000
10/10 [==============================] - 0s - loss: 0.2394
Epoch 787/1000
10/10 [==============================] - 0s - loss: 0.2344
Epoch 788/1000
10/10 [==============================] - 0s - loss: 0.2699
Epoch 789/1000
10/10 [==============================] - 0s - loss: 0.2092
Epoch 790/1000
10/10 [==============================] - 0s - loss: 0.2627
Epoch 791/1000
10/10 [==============================] - 0s - loss: 0.2227
Epoch 792/1000
10/10 [==============================] - 0s - loss: 0.2374
Epoch 793/1000
10/10 [==============================] - 0s - loss: 0.2648
Epoch 794/1000
10/10 [==============================] - 0s - loss: 0.2512
Epoch 795/1000
10/10 [==============================] - 0s - loss: 0.2276
Epoch 796/1000
10/10 [==============================] - 0s - loss: 0.2337
Epoch 797/1000
10/10 [==============================] - 0s - loss: 0.2192
Epoch 798/1000
10/10 [==============================] - 0s - loss: 0.2165
Epoch 799/1000
10/10 [==============================] - 0s - loss: 0.2072
Epoch 800/1000
10/10 [==============================] - 0s - loss: 0.2267
Epoch 801/1000
10/10 [==============================] - 0s - loss: 0.2430
Epoch 802/1000
10/10 [==============================] - 0s - loss: 0.2326
Epoch 803/1000
10/10 [==============================] - 0s - loss: 0.2244
Epoch 804/1000
10/10 [==============================] - 0s - loss: 0.2475
Epoch 805/1000
10/10 [==============================] - 0s - loss: 0.2517
Epoch 806/1000
10/10 [==============================] - 0s - loss: 0.2476
Epoch 807/1000
10/10 [==============================] - 0s - loss: 0.2444
Epoch 808/1000
10/10 [==============================] - 0s - loss: 0.2310
Epoch 809/1000
10/10 [==============================] - 0s - loss: 0.2152
Epoch 810/1000
10/10 [==============================] - 0s - loss: 0.2051
Epoch 811/1000
10/10 [==============================] - 0s - loss: 0.2221
Epoch 812/1000
10/10 [==============================] - 0s - loss: 0.2154
Epoch 813/1000
10/10 [==============================] - 0s - loss: 0.2394
Epoch 814/1000
10/10 [==============================] - 0s - loss: 0.2309
Epoch 815/1000
10/10 [==============================] - 0s - loss: 0.2630
Epoch 816/1000
10/10 [==============================] - 0s - loss: 0.2235
Epoch 817/1000
10/10 [==============================] - 0s - loss: 0.2556
Epoch 818/1000
10/10 [==============================] - 0s - loss: 0.2578
Epoch 819/1000
10/10 [==============================] - 0s - loss: 0.2015
Epoch 820/1000
10/10 [==============================] - 0s - loss: 0.2491
Epoch 821/1000
10/10 [==============================] - 0s - loss: 0.2294
Epoch 822/1000
10/10 [==============================] - 0s - loss: 0.2218
Epoch 823/1000
10/10 [==============================] - 0s - loss: 0.2214
Epoch 824/1000
10/10 [==============================] - 0s - loss: 0.2109
Epoch 825/1000
10/10 [==============================] - 0s - loss: 0.2034
Epoch 826/1000
10/10 [==============================] - 0s - loss: 0.2485
Epoch 827/1000
10/10 [==============================] - 0s - loss: 0.2502
Epoch 828/1000
10/10 [==============================] - 0s - loss: 0.2099
Epoch 829/1000
10/10 [==============================] - 0s - loss: 0.2041
Epoch 830/1000
10/10 [==============================] - 0s - loss: 0.2350
Epoch 831/1000
10/10 [==============================] - 0s - loss: 0.2117
Epoch 832/1000
10/10 [==============================] - 0s - loss: 0.1825
Epoch 833/1000
10/10 [==============================] - 0s - loss: 0.2227
Epoch 834/1000
10/10 [==============================] - 0s - loss: 0.2429
Epoch 835/1000
10/10 [==============================] - 0s - loss: 0.2172
Epoch 836/1000
10/10 [==============================] - 0s - loss: 0.2320
Epoch 837/1000
10/10 [==============================] - 0s - loss: 0.2558
Epoch 838/1000
10/10 [==============================] - 0s - loss: 0.2437
Epoch 839/1000
10/10 [==============================] - 0s - loss: 0.2597
Epoch 840/1000
10/10 [==============================] - 0s - loss: 0.2572
Epoch 841/1000
10/10 [==============================] - 0s - loss: 0.2314
Epoch 842/1000
10/10 [==============================] - 0s - loss: 0.2506
Epoch 843/1000
10/10 [==============================] - 0s - loss: 0.2495
Epoch 844/1000
10/10 [==============================] - 0s - loss: 0.2119
Epoch 845/1000
10/10 [==============================] - 0s - loss: 0.2173
Epoch 846/1000
10/10 [==============================] - 0s - loss: 0.2196
Epoch 847/1000
10/10 [==============================] - 0s - loss: 0.2532
Epoch 848/1000
10/10 [==============================] - 0s - loss: 0.1988
Epoch 849/1000
10/10 [==============================] - 0s - loss: 0.2283
Epoch 850/1000
10/10 [==============================] - 0s - loss: 0.2109
Epoch 851/1000
10/10 [==============================] - 0s - loss: 0.2316
Epoch 852/1000
10/10 [==============================] - 0s - loss: 0.2638
Epoch 853/1000
10/10 [==============================] - 0s - loss: 0.1798
Epoch 854/1000
10/10 [==============================] - 0s - loss: 0.2388
Epoch 855/1000
10/10 [==============================] - 0s - loss: 0.1975
Epoch 856/1000
10/10 [==============================] - 0s - loss: 0.2534
Epoch 857/1000
10/10 [==============================] - 0s - loss: 0.2271
Epoch 858/1000
10/10 [==============================] - 0s - loss: 0.2128
Epoch 859/1000
10/10 [==============================] - 0s - loss: 0.2405
Epoch 860/1000
10/10 [==============================] - 0s - loss: 0.1826
Epoch 861/1000
10/10 [==============================] - 0s - loss: 0.1957
Epoch 862/1000
10/10 [==============================] - 0s - loss: 0.2191
Epoch 863/1000
10/10 [==============================] - 0s - loss: 0.2289
Epoch 864/1000
10/10 [==============================] - 0s - loss: 0.2591
Epoch 865/1000
10/10 [==============================] - 0s - loss: 0.2215
Epoch 866/1000
10/10 [==============================] - 0s - loss: 0.2127
Epoch 867/1000
10/10 [==============================] - 0s - loss: 0.2304
Epoch 868/1000
10/10 [==============================] - 0s - loss: 0.2320
Epoch 869/1000
10/10 [==============================] - 0s - loss: 0.2280
Epoch 870/1000
10/10 [==============================] - 0s - loss: 0.2718
Epoch 871/1000
10/10 [==============================] - 0s - loss: 0.2410
Epoch 872/1000
10/10 [==============================] - 0s - loss: 0.1969
Epoch 873/1000
10/10 [==============================] - 0s - loss: 0.2258
Epoch 874/1000
10/10 [==============================] - 0s - loss: 0.2286
Epoch 875/1000
10/10 [==============================] - 0s - loss: 0.2140
Epoch 876/1000
10/10 [==============================] - 0s - loss: 0.1876
Epoch 877/1000
10/10 [==============================] - 0s - loss: 0.1900
Epoch 878/1000
10/10 [==============================] - 0s - loss: 0.2251
Epoch 879/1000
10/10 [==============================] - 0s - loss: 0.2130
Epoch 880/1000
10/10 [==============================] - 0s - loss: 0.2565
Epoch 881/1000
10/10 [==============================] - 0s - loss: 0.1940
Epoch 882/1000
10/10 [==============================] - 0s - loss: 0.2115
Epoch 883/1000
10/10 [==============================] - 0s - loss: 0.2043
Epoch 884/1000
10/10 [==============================] - 0s - loss: 0.2687
Epoch 885/1000
10/10 [==============================] - 0s - loss: 0.2354
Epoch 886/1000
10/10 [==============================] - 0s - loss: 0.2584
Epoch 887/1000
10/10 [==============================] - 0s - loss: 0.2323
Epoch 888/1000
10/10 [==============================] - 0s - loss: 0.2608
Epoch 889/1000
10/10 [==============================] - 0s - loss: 0.2206
Epoch 890/1000
10/10 [==============================] - 0s - loss: 0.2124
Epoch 891/1000
10/10 [==============================] - 0s - loss: 0.2685
Epoch 892/1000
10/10 [==============================] - 0s - loss: 0.2035
Epoch 893/1000
10/10 [==============================] - 0s - loss: 0.2316
Epoch 894/1000
10/10 [==============================] - 0s - loss: 0.2347
Epoch 895/1000
10/10 [==============================] - 0s - loss: 0.2166
Epoch 896/1000
10/10 [==============================] - 0s - loss: 0.2028
Epoch 897/1000
10/10 [==============================] - 0s - loss: 0.2262
Epoch 898/1000
10/10 [==============================] - 0s - loss: 0.1995
Epoch 899/1000
10/10 [==============================] - 0s - loss: 0.1911
Epoch 900/1000
10/10 [==============================] - 0s - loss: 0.2282
Epoch 901/1000
10/10 [==============================] - 0s - loss: 0.2261
Epoch 902/1000
10/10 [==============================] - 0s - loss: 0.2274
Epoch 903/1000
10/10 [==============================] - 0s - loss: 0.2137
Epoch 904/1000
10/10 [==============================] - 0s - loss: 0.1899
Epoch 905/1000
10/10 [==============================] - 0s - loss: 0.2151
Epoch 906/1000
10/10 [==============================] - 0s - loss: 0.2472
Epoch 907/1000
10/10 [==============================] - 0s - loss: 0.2022
Epoch 908/1000
10/10 [==============================] - 0s - loss: 0.2391
Epoch 909/1000
10/10 [==============================] - 0s - loss: 0.2397
Epoch 910/1000
10/10 [==============================] - 0s - loss: 0.2088
Epoch 911/1000
10/10 [==============================] - 0s - loss: 0.2045
Epoch 912/1000
10/10 [==============================] - 0s - loss: 0.2027
Epoch 913/1000
10/10 [==============================] - 0s - loss: 0.1953
Epoch 914/1000
10/10 [==============================] - 0s - loss: 0.2563
Epoch 915/1000
10/10 [==============================] - 0s - loss: 0.2230
Epoch 916/1000
10/10 [==============================] - 0s - loss: 0.1862
Epoch 917/1000
10/10 [==============================] - 0s - loss: 0.1739
Epoch 918/1000
10/10 [==============================] - 0s - loss: 0.2277
Epoch 919/1000
10/10 [==============================] - 0s - loss: 0.2238
Epoch 920/1000
10/10 [==============================] - 0s - loss: 0.2151
Epoch 921/1000
10/10 [==============================] - 0s - loss: 0.1934
Epoch 922/1000
10/10 [==============================] - 0s - loss: 0.1969
Epoch 923/1000
10/10 [==============================] - 0s - loss: 0.1927
Epoch 924/1000
10/10 [==============================] - 0s - loss: 0.2316
Epoch 925/1000
10/10 [==============================] - 0s - loss: 0.1946
Epoch 926/1000
10/10 [==============================] - 0s - loss: 0.2169
Epoch 927/1000
10/10 [==============================] - 0s - loss: 0.2235
Epoch 928/1000
10/10 [==============================] - 0s - loss: 0.2173
Epoch 929/1000
10/10 [==============================] - 0s - loss: 0.2292
Epoch 930/1000
10/10 [==============================] - 0s - loss: 0.2006
Epoch 931/1000
10/10 [==============================] - 0s - loss: 0.2515
Epoch 932/1000
10/10 [==============================] - 0s - loss: 0.2900
Epoch 933/1000
10/10 [==============================] - 0s - loss: 0.1743
Epoch 934/1000
10/10 [==============================] - 0s - loss: 0.2154
Epoch 935/1000
10/10 [==============================] - 0s - loss: 0.1993
Epoch 936/1000
10/10 [==============================] - 0s - loss: 0.2212
Epoch 937/1000
10/10 [==============================] - 0s - loss: 0.1935
Epoch 938/1000
10/10 [==============================] - 0s - loss: 0.2259
Epoch 939/1000
10/10 [==============================] - 0s - loss: 0.1971
Epoch 940/1000
10/10 [==============================] - 0s - loss: 0.2524
Epoch 941/1000
10/10 [==============================] - 0s - loss: 0.2146
Epoch 942/1000
10/10 [==============================] - 0s - loss: 0.1981
Epoch 943/1000
10/10 [==============================] - 0s - loss: 0.2101
Epoch 944/1000
10/10 [==============================] - 0s - loss: 0.2070
Epoch 945/1000
10/10 [==============================] - 0s - loss: 0.2106
Epoch 946/1000
10/10 [==============================] - 0s - loss: 0.2166
Epoch 947/1000
10/10 [==============================] - 0s - loss: 0.2055
Epoch 948/1000
10/10 [==============================] - 0s - loss: 0.1812
Epoch 949/1000
10/10 [==============================] - 0s - loss: 0.2107
Epoch 950/1000
10/10 [==============================] - 0s - loss: 0.2117
Epoch 951/1000
10/10 [==============================] - 0s - loss: 0.2226
Epoch 952/1000
10/10 [==============================] - 0s - loss: 0.2244
Epoch 953/1000
10/10 [==============================] - 0s - loss: 0.2439
Epoch 954/1000
10/10 [==============================] - 0s - loss: 0.1963
Epoch 955/1000
10/10 [==============================] - 0s - loss: 0.2282
Epoch 956/1000
10/10 [==============================] - 0s - loss: 0.1693
Epoch 957/1000
10/10 [==============================] - 0s - loss: 0.2014
Epoch 958/1000
10/10 [==============================] - 0s - loss: 0.2051
Epoch 959/1000
10/10 [==============================] - 0s - loss: 0.2191
Epoch 960/1000
10/10 [==============================] - 0s - loss: 0.1856
Epoch 961/1000
10/10 [==============================] - 0s - loss: 0.2434
Epoch 962/1000
10/10 [==============================] - 0s - loss: 0.2065
Epoch 963/1000
10/10 [==============================] - 0s - loss: 0.2491
Epoch 964/1000
10/10 [==============================] - 0s - loss: 0.2301
Epoch 965/1000
10/10 [==============================] - 0s - loss: 0.2337
Epoch 966/1000
10/10 [==============================] - 0s - loss: 0.1971
Epoch 967/1000
10/10 [==============================] - 0s - loss: 0.2086
Epoch 968/1000
10/10 [==============================] - 0s - loss: 0.1958
Epoch 969/1000
10/10 [==============================] - 0s - loss: 0.1786
Epoch 970/1000
10/10 [==============================] - 0s - loss: 0.2253
Epoch 971/1000
10/10 [==============================] - 0s - loss: 0.2089
Epoch 972/1000
10/10 [==============================] - 0s - loss: 0.2331
Epoch 973/1000
10/10 [==============================] - 0s - loss: 0.1973
Epoch 974/1000
10/10 [==============================] - 0s - loss: 0.1841
Epoch 975/1000
10/10 [==============================] - 0s - loss: 0.2226
Epoch 976/1000
10/10 [==============================] - 0s - loss: 0.1971
Epoch 977/1000
10/10 [==============================] - 0s - loss: 0.1940
Epoch 978/1000
10/10 [==============================] - 0s - loss: 0.2250
Epoch 979/1000
10/10 [==============================] - 0s - loss: 0.2237
Epoch 980/1000
10/10 [==============================] - 0s - loss: 0.1857
Epoch 981/1000
10/10 [==============================] - 0s - loss: 0.2090
Epoch 982/1000
10/10 [==============================] - 0s - loss: 0.2158
Epoch 983/1000
10/10 [==============================] - 0s - loss: 0.2260
Epoch 984/1000
10/10 [==============================] - 0s - loss: 0.1691
Epoch 985/1000
10/10 [==============================] - 0s - loss: 0.1916
Epoch 986/1000
10/10 [==============================] - 0s - loss: 0.2079
Epoch 987/1000
10/10 [==============================] - 0s - loss: 0.2367
Epoch 988/1000
10/10 [==============================] - 0s - loss: 0.2261
Epoch 989/1000
10/10 [==============================] - 0s - loss: 0.2046
Epoch 990/1000
10/10 [==============================] - 0s - loss: 0.2157
Epoch 991/1000
10/10 [==============================] - 0s - loss: 0.2095
Epoch 992/1000
10/10 [==============================] - 0s - loss: 0.2294
Epoch 993/1000
10/10 [==============================] - 0s - loss: 0.2253
Epoch 994/1000
10/10 [==============================] - 0s - loss: 0.2001
Epoch 995/1000
10/10 [==============================] - 0s - loss: 0.1844
Epoch 996/1000
10/10 [==============================] - 0s - loss: 0.2177
Epoch 997/1000
10/10 [==============================] - 0s - loss: 0.2160
Epoch 998/1000
10/10 [==============================] - 0s - loss: 0.1923
Epoch 999/1000
10/10 [==============================] - 0s - loss: 0.2212
Epoch 1000/1000
10/10 [==============================] - 0s - loss: 0.2602










    
Out[180]:








<keras.callbacks.History at 0x2308a23f550>

















In [182]:



    


import matplotlib.pyplot as plt
%matplotlib inline
z = 12
plt.figure(figsize=(10, 50))
for j, i in enumerate(numpy.random.randint(100, size=(1,))):
    plt.subplot(10, 2, 2 * j + 1)
    plt.title('Original')
    plt.imshow(images[i, z:-z, z:-z], cmap='inferno')
    plt.subplot(10, 2, 2 * j + 2)
    plt.title('Reconstruction')
    plt.imshow(-model.predict(images[i].reshape((-1, 1, 32, 32)))[0, z:-z, z:-z], cmap='inferno')

Okay, it's negative, but it looks good anyway. Let's check out the weights.





In [124]:



    


for index, weights in enumerate(model.layers[0].get_weights()[0]):
    plt.subplot(4, 8, index + 1)
    plt.imshow(weights.reshape((5, 5)))
plt.show()

¯_(ツ)_/¯





In [ ]:

Content source: chengsoonong/crowdastro

Similar notebooks:

notebook.community | gallery | about