notebook.community

Edit and run

Sinusoid autoencoder trained with multiple phases

Let's provide more training examples - sinusoid with various phases.





In [3]:



    


%pylab inline
import keras
import numpy as np
import keras



    


















    






Populating the interactive namespace from numpy and matplotlib

















In [4]:



    


N = 50
# phase_step = 1 / (2 * np.pi)
t = np.arange(50)
phases = np.linspace(0, 1, N) * 2 * np.pi
x = np.array([np.sin(2 * np.pi / N * t + phi) for phi in phases])
print(x.shape)
imshow(x);



    


















    






(50, 50)










    
























In [5]:



    


plot(x[0]);
plot(x[1]);
plot(x[2]);



    


















    
























In [6]:



    


from keras.models import Sequential
from keras.layers import containers
from keras.layers.core import Dense, AutoEncoder

encoder = containers.Sequential([
        Dense(25, input_dim=50),
        Dense(12)
    ])
decoder = containers.Sequential([
        Dense(25, input_dim=12),
        Dense(50)
    ])

model = Sequential()
model.add(AutoEncoder(encoder=encoder, decoder=decoder, output_reconstruction=True))

model.compile(loss='mean_squared_error', optimizer='sgd')



    











In [7]:



    


plot(model.predict(x)[0]);



    


















    
























In [8]:



    


from loss_history import LossHistory
loss_history = LossHistory()
model.fit(x, x, nb_epoch=1000, batch_size=50, callbacks=[loss_history])



    


















    






Epoch 1/1000
50/50 [==============================] - 0s - loss: 0.7450
Epoch 2/1000
50/50 [==============================] - 0s - loss: 0.7090
Epoch 3/1000
50/50 [==============================] - 0s - loss: 0.6778
Epoch 4/1000
50/50 [==============================] - 0s - loss: 0.6507
Epoch 5/1000
50/50 [==============================] - 0s - loss: 0.6269
Epoch 6/1000
50/50 [==============================] - 0s - loss: 0.6059
Epoch 7/1000
50/50 [==============================] - 0s - loss: 0.5872
Epoch 8/1000
50/50 [==============================] - 0s - loss: 0.5704
Epoch 9/1000
50/50 [==============================] - 0s - loss: 0.5553
Epoch 10/1000
50/50 [==============================] - 0s - loss: 0.5417
Epoch 11/1000
50/50 [==============================] - 0s - loss: 0.5293
Epoch 12/1000
50/50 [==============================] - 0s - loss: 0.5179
Epoch 13/1000
50/50 [==============================] - 0s - loss: 0.5075
Epoch 14/1000
50/50 [==============================] - 0s - loss: 0.4980
Epoch 15/1000
50/50 [==============================] - 0s - loss: 0.4891
Epoch 16/1000
50/50 [==============================] - 0s - loss: 0.4809
Epoch 17/1000
50/50 [==============================] - 0s - loss: 0.4733
Epoch 18/1000
50/50 [==============================] - 0s - loss: 0.4662
Epoch 19/1000
50/50 [==============================] - 0s - loss: 0.4595
Epoch 20/1000
50/50 [==============================] - 0s - loss: 0.4533
Epoch 21/1000
50/50 [==============================] - 0s - loss: 0.4474
Epoch 22/1000
50/50 [==============================] - 0s - loss: 0.4418
Epoch 23/1000
50/50 [==============================] - 0s - loss: 0.4366
Epoch 24/1000
50/50 [==============================] - 0s - loss: 0.4316
Epoch 25/1000
50/50 [==============================] - 0s - loss: 0.4269
Epoch 26/1000
50/50 [==============================] - 0s - loss: 0.4224
Epoch 27/1000
50/50 [==============================] - 0s - loss: 0.4181
Epoch 28/1000
50/50 [==============================] - 0s - loss: 0.4141
Epoch 29/1000
50/50 [==============================] - 0s - loss: 0.4101
Epoch 30/1000
50/50 [==============================] - 0s - loss: 0.4064
Epoch 31/1000
50/50 [==============================] - 0s - loss: 0.4028
Epoch 32/1000
50/50 [==============================] - 0s - loss: 0.3993
Epoch 33/1000
50/50 [==============================] - 0s - loss: 0.3960
Epoch 34/1000
50/50 [==============================] - 0s - loss: 0.3928
Epoch 35/1000
50/50 [==============================] - 0s - loss: 0.3897
Epoch 36/1000
50/50 [==============================] - 0s - loss: 0.3867
Epoch 37/1000
50/50 [==============================] - 0s - loss: 0.3838
Epoch 38/1000
50/50 [==============================] - 0s - loss: 0.3810
Epoch 39/1000
50/50 [==============================] - 0s - loss: 0.3782
Epoch 40/1000
50/50 [==============================] - 0s - loss: 0.3756
Epoch 41/1000
50/50 [==============================] - 0s - loss: 0.3730
Epoch 42/1000
50/50 [==============================] - 0s - loss: 0.3705
Epoch 43/1000
50/50 [==============================] - 0s - loss: 0.3680
Epoch 44/1000
50/50 [==============================] - 0s - loss: 0.3656
Epoch 45/1000
50/50 [==============================] - 0s - loss: 0.3633
Epoch 46/1000
50/50 [==============================] - 0s - loss: 0.3610
Epoch 47/1000
50/50 [==============================] - 0s - loss: 0.3588
Epoch 48/1000
50/50 [==============================] - 0s - loss: 0.3566
Epoch 49/1000
50/50 [==============================] - 0s - loss: 0.3545
Epoch 50/1000
50/50 [==============================] - 0s - loss: 0.3524
Epoch 51/1000
50/50 [==============================] - 0s - loss: 0.3503
Epoch 52/1000
50/50 [==============================] - 0s - loss: 0.3483
Epoch 53/1000
50/50 [==============================] - 0s - loss: 0.3463
Epoch 54/1000
50/50 [==============================] - 0s - loss: 0.3444
Epoch 55/1000
50/50 [==============================] - 0s - loss: 0.3424
Epoch 56/1000
50/50 [==============================] - 0s - loss: 0.3405
Epoch 57/1000
50/50 [==============================] - 0s - loss: 0.3387
Epoch 58/1000
50/50 [==============================] - 0s - loss: 0.3368
Epoch 59/1000
50/50 [==============================] - 0s - loss: 0.3350
Epoch 60/1000
50/50 [==============================] - 0s - loss: 0.3332
Epoch 61/1000
50/50 [==============================] - 0s - loss: 0.3315
Epoch 62/1000
50/50 [==============================] - 0s - loss: 0.3297
Epoch 63/1000
50/50 [==============================] - 0s - loss: 0.3280
Epoch 64/1000
50/50 [==============================] - 0s - loss: 0.3263
Epoch 65/1000
50/50 [==============================] - 0s - loss: 0.3246
Epoch 66/1000
50/50 [==============================] - 0s - loss: 0.3230
Epoch 67/1000
50/50 [==============================] - 0s - loss: 0.3213
Epoch 68/1000
50/50 [==============================] - 0s - loss: 0.3197
Epoch 69/1000
50/50 [==============================] - 0s - loss: 0.3181
Epoch 70/1000
50/50 [==============================] - 0s - loss: 0.3165
Epoch 71/1000
50/50 [==============================] - 0s - loss: 0.3149
Epoch 72/1000
50/50 [==============================] - 0s - loss: 0.3133
Epoch 73/1000
50/50 [==============================] - 0s - loss: 0.3117
Epoch 74/1000
50/50 [==============================] - 0s - loss: 0.3102
Epoch 75/1000
50/50 [==============================] - 0s - loss: 0.3087
Epoch 76/1000
50/50 [==============================] - 0s - loss: 0.3071
Epoch 77/1000
50/50 [==============================] - 0s - loss: 0.3056
Epoch 78/1000
50/50 [==============================] - 0s - loss: 0.3041
Epoch 79/1000
50/50 [==============================] - 0s - loss: 0.3026
Epoch 80/1000
50/50 [==============================] - 0s - loss: 0.3011
Epoch 81/1000
50/50 [==============================] - 0s - loss: 0.2997
Epoch 82/1000
50/50 [==============================] - 0s - loss: 0.2982
Epoch 83/1000
50/50 [==============================] - 0s - loss: 0.2967
Epoch 84/1000
50/50 [==============================] - 0s - loss: 0.2953
Epoch 85/1000
50/50 [==============================] - 0s - loss: 0.2938
Epoch 86/1000
50/50 [==============================] - 0s - loss: 0.2924
Epoch 87/1000
50/50 [==============================] - 0s - loss: 0.2910
Epoch 88/1000
50/50 [==============================] - 0s - loss: 0.2896
Epoch 89/1000
50/50 [==============================] - 0s - loss: 0.2881
Epoch 90/1000
50/50 [==============================] - 0s - loss: 0.2867
Epoch 91/1000
50/50 [==============================] - 0s - loss: 0.2853
Epoch 92/1000
50/50 [==============================] - 0s - loss: 0.2839
Epoch 93/1000
50/50 [==============================] - 0s - loss: 0.2826
Epoch 94/1000
50/50 [==============================] - 0s - loss: 0.2812
Epoch 95/1000
50/50 [==============================] - 0s - loss: 0.2798
Epoch 96/1000
50/50 [==============================] - 0s - loss: 0.2784
Epoch 97/1000
50/50 [==============================] - 0s - loss: 0.2770
Epoch 98/1000
50/50 [==============================] - 0s - loss: 0.2757
Epoch 99/1000
50/50 [==============================] - 0s - loss: 0.2743
Epoch 100/1000
50/50 [==============================] - 0s - loss: 0.2730
Epoch 101/1000
50/50 [==============================] - 0s - loss: 0.2716
Epoch 102/1000
50/50 [==============================] - 0s - loss: 0.2703
Epoch 103/1000
50/50 [==============================] - 0s - loss: 0.2689
Epoch 104/1000
50/50 [==============================] - 0s - loss: 0.2676
Epoch 105/1000
50/50 [==============================] - 0s - loss: 0.2663
Epoch 106/1000
50/50 [==============================] - 0s - loss: 0.2650
Epoch 107/1000
50/50 [==============================] - 0s - loss: 0.2636
Epoch 108/1000
50/50 [==============================] - 0s - loss: 0.2623
Epoch 109/1000
50/50 [==============================] - 0s - loss: 0.2610
Epoch 110/1000
50/50 [==============================] - 0s - loss: 0.2597
Epoch 111/1000
50/50 [==============================] - 0s - loss: 0.2584
Epoch 112/1000
50/50 [==============================] - 0s - loss: 0.2571
Epoch 113/1000
50/50 [==============================] - 0s - loss: 0.2558
Epoch 114/1000
50/50 [==============================] - 0s - loss: 0.2545
Epoch 115/1000
50/50 [==============================] - 0s - loss: 0.2532
Epoch 116/1000
50/50 [==============================] - 0s - loss: 0.2519
Epoch 117/1000
50/50 [==============================] - 0s - loss: 0.2506
Epoch 118/1000
50/50 [==============================] - 0s - loss: 0.2493
Epoch 119/1000
50/50 [==============================] - 0s - loss: 0.2480
Epoch 120/1000
50/50 [==============================] - 0s - loss: 0.2468
Epoch 121/1000
50/50 [==============================] - 0s - loss: 0.2455
Epoch 122/1000
50/50 [==============================] - 0s - loss: 0.2442
Epoch 123/1000
50/50 [==============================] - 0s - loss: 0.2430
Epoch 124/1000
50/50 [==============================] - 0s - loss: 0.2417
Epoch 125/1000
50/50 [==============================] - 0s - loss: 0.2404
Epoch 126/1000
50/50 [==============================] - 0s - loss: 0.2392
Epoch 127/1000
50/50 [==============================] - 0s - loss: 0.2379
Epoch 128/1000
50/50 [==============================] - 0s - loss: 0.2367
Epoch 129/1000
50/50 [==============================] - 0s - loss: 0.2354
Epoch 130/1000
50/50 [==============================] - 0s - loss: 0.2342
Epoch 131/1000
50/50 [==============================] - 0s - loss: 0.2330
Epoch 132/1000
50/50 [==============================] - 0s - loss: 0.2317
Epoch 133/1000
50/50 [==============================] - 0s - loss: 0.2305
Epoch 134/1000
50/50 [==============================] - 0s - loss: 0.2292
Epoch 135/1000
50/50 [==============================] - 0s - loss: 0.2280
Epoch 136/1000
50/50 [==============================] - 0s - loss: 0.2268
Epoch 137/1000
50/50 [==============================] - 0s - loss: 0.2256
Epoch 138/1000
50/50 [==============================] - 0s - loss: 0.2244
Epoch 139/1000
50/50 [==============================] - 0s - loss: 0.2231
Epoch 140/1000
50/50 [==============================] - 0s - loss: 0.2219
Epoch 141/1000
50/50 [==============================] - 0s - loss: 0.2207
Epoch 142/1000
50/50 [==============================] - 0s - loss: 0.2195
Epoch 143/1000
50/50 [==============================] - 0s - loss: 0.2183
Epoch 144/1000
50/50 [==============================] - 0s - loss: 0.2171
Epoch 145/1000
50/50 [==============================] - 0s - loss: 0.2159
Epoch 146/1000
50/50 [==============================] - 0s - loss: 0.2147
Epoch 147/1000
50/50 [==============================] - 0s - loss: 0.2135
Epoch 148/1000
50/50 [==============================] - 0s - loss: 0.2124
Epoch 149/1000
50/50 [==============================] - 0s - loss: 0.2112
Epoch 150/1000
50/50 [==============================] - 0s - loss: 0.2100
Epoch 151/1000
50/50 [==============================] - 0s - loss: 0.2088
Epoch 152/1000
50/50 [==============================] - 0s - loss: 0.2076
Epoch 153/1000
50/50 [==============================] - 0s - loss: 0.2065
Epoch 154/1000
50/50 [==============================] - 0s - loss: 0.2053
Epoch 155/1000
50/50 [==============================] - 0s - loss: 0.2041
Epoch 156/1000
50/50 [==============================] - 0s - loss: 0.2030
Epoch 157/1000
50/50 [==============================] - 0s - loss: 0.2018
Epoch 158/1000
50/50 [==============================] - 0s - loss: 0.2007
Epoch 159/1000
50/50 [==============================] - 0s - loss: 0.1995
Epoch 160/1000
50/50 [==============================] - 0s - loss: 0.1984
Epoch 161/1000
50/50 [==============================] - 0s - loss: 0.1973
Epoch 162/1000
50/50 [==============================] - 0s - loss: 0.1961
Epoch 163/1000
50/50 [==============================] - 0s - loss: 0.1950
Epoch 164/1000
50/50 [==============================] - 0s - loss: 0.1939
Epoch 165/1000
50/50 [==============================] - 0s - loss: 0.1927
Epoch 166/1000
50/50 [==============================] - 0s - loss: 0.1916
Epoch 167/1000
50/50 [==============================] - 0s - loss: 0.1905
Epoch 168/1000
50/50 [==============================] - 0s - loss: 0.1894
Epoch 169/1000
50/50 [==============================] - 0s - loss: 0.1883
Epoch 170/1000
50/50 [==============================] - 0s - loss: 0.1872
Epoch 171/1000
50/50 [==============================] - 0s - loss: 0.1861
Epoch 172/1000
50/50 [==============================] - 0s - loss: 0.1850
Epoch 173/1000
50/50 [==============================] - 0s - loss: 0.1839
Epoch 174/1000
50/50 [==============================] - 0s - loss: 0.1828
Epoch 175/1000
50/50 [==============================] - 0s - loss: 0.1817
Epoch 176/1000
50/50 [==============================] - 0s - loss: 0.1806
Epoch 177/1000
50/50 [==============================] - 0s - loss: 0.1795
Epoch 178/1000
50/50 [==============================] - 0s - loss: 0.1784
Epoch 179/1000
50/50 [==============================] - 0s - loss: 0.1774
Epoch 180/1000
50/50 [==============================] - 0s - loss: 0.1763
Epoch 181/1000
50/50 [==============================] - 0s - loss: 0.1752
Epoch 182/1000
50/50 [==============================] - 0s - loss: 0.1742
Epoch 183/1000
50/50 [==============================] - 0s - loss: 0.1731
Epoch 184/1000
50/50 [==============================] - 0s - loss: 0.1721
Epoch 185/1000
50/50 [==============================] - 0s - loss: 0.1710
Epoch 186/1000
50/50 [==============================] - 0s - loss: 0.1700
Epoch 187/1000
50/50 [==============================] - 0s - loss: 0.1690
Epoch 188/1000
50/50 [==============================] - 0s - loss: 0.1679
Epoch 189/1000
50/50 [==============================] - 0s - loss: 0.1669
Epoch 190/1000
50/50 [==============================] - 0s - loss: 0.1659
Epoch 191/1000
50/50 [==============================] - 0s - loss: 0.1648
Epoch 192/1000
50/50 [==============================] - 0s - loss: 0.1638
Epoch 193/1000
50/50 [==============================] - 0s - loss: 0.1628
Epoch 194/1000
50/50 [==============================] - 0s - loss: 0.1618
Epoch 195/1000
50/50 [==============================] - 0s - loss: 0.1608
Epoch 196/1000
50/50 [==============================] - 0s - loss: 0.1598
Epoch 197/1000
50/50 [==============================] - 0s - loss: 0.1588
Epoch 198/1000
50/50 [==============================] - 0s - loss: 0.1578
Epoch 199/1000
50/50 [==============================] - 0s - loss: 0.1568
Epoch 200/1000
50/50 [==============================] - 0s - loss: 0.1559
Epoch 201/1000
50/50 [==============================] - 0s - loss: 0.1549
Epoch 202/1000
50/50 [==============================] - 0s - loss: 0.1539
Epoch 203/1000
50/50 [==============================] - 0s - loss: 0.1529
Epoch 204/1000
50/50 [==============================] - 0s - loss: 0.1520
Epoch 205/1000
50/50 [==============================] - 0s - loss: 0.1510
Epoch 206/1000
50/50 [==============================] - 0s - loss: 0.1501
Epoch 207/1000
50/50 [==============================] - 0s - loss: 0.1491
Epoch 208/1000
50/50 [==============================] - 0s - loss: 0.1482
Epoch 209/1000
50/50 [==============================] - 0s - loss: 0.1472
Epoch 210/1000
50/50 [==============================] - 0s - loss: 0.1463
Epoch 211/1000
50/50 [==============================] - 0s - loss: 0.1454
Epoch 212/1000
50/50 [==============================] - 0s - loss: 0.1445
Epoch 213/1000
50/50 [==============================] - 0s - loss: 0.1435
Epoch 214/1000
50/50 [==============================] - 0s - loss: 0.1426
Epoch 215/1000
50/50 [==============================] - 0s - loss: 0.1417
Epoch 216/1000
50/50 [==============================] - 0s - loss: 0.1408
Epoch 217/1000
50/50 [==============================] - 0s - loss: 0.1399
Epoch 218/1000
50/50 [==============================] - 0s - loss: 0.1390
Epoch 219/1000
50/50 [==============================] - 0s - loss: 0.1381
Epoch 220/1000
50/50 [==============================] - 0s - loss: 0.1372
Epoch 221/1000
50/50 [==============================] - 0s - loss: 0.1363
Epoch 222/1000
50/50 [==============================] - 0s - loss: 0.1355
Epoch 223/1000
50/50 [==============================] - 0s - loss: 0.1346
Epoch 224/1000
50/50 [==============================] - 0s - loss: 0.1337
Epoch 225/1000
50/50 [==============================] - 0s - loss: 0.1329
Epoch 226/1000
50/50 [==============================] - 0s - loss: 0.1320
Epoch 227/1000
50/50 [==============================] - 0s - loss: 0.1311
Epoch 228/1000
50/50 [==============================] - 0s - loss: 0.1303
Epoch 229/1000
50/50 [==============================] - 0s - loss: 0.1295
Epoch 230/1000
50/50 [==============================] - 0s - loss: 0.1286
Epoch 231/1000
50/50 [==============================] - 0s - loss: 0.1278
Epoch 232/1000
50/50 [==============================] - 0s - loss: 0.1269
Epoch 233/1000
50/50 [==============================] - 0s - loss: 0.1261
Epoch 234/1000
50/50 [==============================] - 0s - loss: 0.1253
Epoch 235/1000
50/50 [==============================] - 0s - loss: 0.1245
Epoch 236/1000
50/50 [==============================] - 0s - loss: 0.1237
Epoch 237/1000
50/50 [==============================] - 0s - loss: 0.1229
Epoch 238/1000
50/50 [==============================] - 0s - loss: 0.1221
Epoch 239/1000
50/50 [==============================] - 0s - loss: 0.1213
Epoch 240/1000
50/50 [==============================] - 0s - loss: 0.1205
Epoch 241/1000
50/50 [==============================] - 0s - loss: 0.1197
Epoch 242/1000
50/50 [==============================] - 0s - loss: 0.1189
Epoch 243/1000
50/50 [==============================] - 0s - loss: 0.1181
Epoch 244/1000
50/50 [==============================] - 0s - loss: 0.1174
Epoch 245/1000
50/50 [==============================] - 0s - loss: 0.1166
Epoch 246/1000
50/50 [==============================] - 0s - loss: 0.1158
Epoch 247/1000
50/50 [==============================] - 0s - loss: 0.1151
Epoch 248/1000
50/50 [==============================] - 0s - loss: 0.1143
Epoch 249/1000
50/50 [==============================] - 0s - loss: 0.1136
Epoch 250/1000
50/50 [==============================] - 0s - loss: 0.1128
Epoch 251/1000
50/50 [==============================] - 0s - loss: 0.1121
Epoch 252/1000
50/50 [==============================] - 0s - loss: 0.1113
Epoch 253/1000
50/50 [==============================] - 0s - loss: 0.1106
Epoch 254/1000
50/50 [==============================] - 0s - loss: 0.1099
Epoch 255/1000
50/50 [==============================] - 0s - loss: 0.1092
Epoch 256/1000
50/50 [==============================] - 0s - loss: 0.1085
Epoch 257/1000
50/50 [==============================] - 0s - loss: 0.1077
Epoch 258/1000
50/50 [==============================] - 0s - loss: 0.1070
Epoch 259/1000
50/50 [==============================] - 0s - loss: 0.1063
Epoch 260/1000
50/50 [==============================] - 0s - loss: 0.1056
Epoch 261/1000
50/50 [==============================] - 0s - loss: 0.1049
Epoch 262/1000
50/50 [==============================] - 0s - loss: 0.1042
Epoch 263/1000
50/50 [==============================] - 0s - loss: 0.1036
Epoch 264/1000
50/50 [==============================] - 0s - loss: 0.1029
Epoch 265/1000
50/50 [==============================] - 0s - loss: 0.1022
Epoch 266/1000
50/50 [==============================] - 0s - loss: 0.1015
Epoch 267/1000
50/50 [==============================] - 0s - loss: 0.1009
Epoch 268/1000
50/50 [==============================] - 0s - loss: 0.1002
Epoch 269/1000
50/50 [==============================] - 0s - loss: 0.0995
Epoch 270/1000
50/50 [==============================] - 0s - loss: 0.0989
Epoch 271/1000
50/50 [==============================] - 0s - loss: 0.0982
Epoch 272/1000
50/50 [==============================] - 0s - loss: 0.0976
Epoch 273/1000
50/50 [==============================] - 0s - loss: 0.0970
Epoch 274/1000
50/50 [==============================] - 0s - loss: 0.0963
Epoch 275/1000
50/50 [==============================] - 0s - loss: 0.0957
Epoch 276/1000
50/50 [==============================] - 0s - loss: 0.0951
Epoch 277/1000
50/50 [==============================] - 0s - loss: 0.0944
Epoch 278/1000
50/50 [==============================] - 0s - loss: 0.0938
Epoch 279/1000
50/50 [==============================] - 0s - loss: 0.0932
Epoch 280/1000
50/50 [==============================] - 0s - loss: 0.0926
Epoch 281/1000
50/50 [==============================] - 0s - loss: 0.0920
Epoch 282/1000
50/50 [==============================] - 0s - loss: 0.0914
Epoch 283/1000
50/50 [==============================] - 0s - loss: 0.0908
Epoch 284/1000
50/50 [==============================] - 0s - loss: 0.0902
Epoch 285/1000
50/50 [==============================] - 0s - loss: 0.0896
Epoch 286/1000
50/50 [==============================] - 0s - loss: 0.0890
Epoch 287/1000
50/50 [==============================] - 0s - loss: 0.0884
Epoch 288/1000
50/50 [==============================] - 0s - loss: 0.0878
Epoch 289/1000
50/50 [==============================] - 0s - loss: 0.0873
Epoch 290/1000
50/50 [==============================] - 0s - loss: 0.0867
Epoch 291/1000
50/50 [==============================] - 0s - loss: 0.0861
Epoch 292/1000
50/50 [==============================] - 0s - loss: 0.0856
Epoch 293/1000
50/50 [==============================] - 0s - loss: 0.0850
Epoch 294/1000
50/50 [==============================] - 0s - loss: 0.0845
Epoch 295/1000
50/50 [==============================] - 0s - loss: 0.0839
Epoch 296/1000
50/50 [==============================] - 0s - loss: 0.0834
Epoch 297/1000
50/50 [==============================] - 0s - loss: 0.0828
Epoch 298/1000
50/50 [==============================] - 0s - loss: 0.0823
Epoch 299/1000
50/50 [==============================] - 0s - loss: 0.0817
Epoch 300/1000
50/50 [==============================] - 0s - loss: 0.0812
Epoch 301/1000
50/50 [==============================] - 0s - loss: 0.0807
Epoch 302/1000
50/50 [==============================] - 0s - loss: 0.0802
Epoch 303/1000
50/50 [==============================] - 0s - loss: 0.0796
Epoch 304/1000
50/50 [==============================] - 0s - loss: 0.0791
Epoch 305/1000
50/50 [==============================] - 0s - loss: 0.0786
Epoch 306/1000
50/50 [==============================] - 0s - loss: 0.0781
Epoch 307/1000
50/50 [==============================] - 0s - loss: 0.0776
Epoch 308/1000
50/50 [==============================] - 0s - loss: 0.0771
Epoch 309/1000
50/50 [==============================] - 0s - loss: 0.0766
Epoch 310/1000
50/50 [==============================] - 0s - loss: 0.0761
Epoch 311/1000
50/50 [==============================] - 0s - loss: 0.0756
Epoch 312/1000
50/50 [==============================] - 0s - loss: 0.0751
Epoch 313/1000
50/50 [==============================] - 0s - loss: 0.0746
Epoch 314/1000
50/50 [==============================] - 0s - loss: 0.0741
Epoch 315/1000
50/50 [==============================] - 0s - loss: 0.0737
Epoch 316/1000
50/50 [==============================] - 0s - loss: 0.0732
Epoch 317/1000
50/50 [==============================] - 0s - loss: 0.0727
Epoch 318/1000
50/50 [==============================] - 0s - loss: 0.0722
Epoch 319/1000
50/50 [==============================] - 0s - loss: 0.0718
Epoch 320/1000
50/50 [==============================] - 0s - loss: 0.0713
Epoch 321/1000
50/50 [==============================] - 0s - loss: 0.0709
Epoch 322/1000
50/50 [==============================] - 0s - loss: 0.0704
Epoch 323/1000
50/50 [==============================] - 0s - loss: 0.0699
Epoch 324/1000
50/50 [==============================] - 0s - loss: 0.0695
Epoch 325/1000
50/50 [==============================] - 0s - loss: 0.0691
Epoch 326/1000
50/50 [==============================] - 0s - loss: 0.0686
Epoch 327/1000
50/50 [==============================] - 0s - loss: 0.0682
Epoch 328/1000
50/50 [==============================] - 0s - loss: 0.0677
Epoch 329/1000
50/50 [==============================] - 0s - loss: 0.0673
Epoch 330/1000
50/50 [==============================] - 0s - loss: 0.0669
Epoch 331/1000
50/50 [==============================] - 0s - loss: 0.0664
Epoch 332/1000
50/50 [==============================] - 0s - loss: 0.0660
Epoch 333/1000
50/50 [==============================] - 0s - loss: 0.0656
Epoch 334/1000
50/50 [==============================] - 0s - loss: 0.0652
Epoch 335/1000
50/50 [==============================] - 0s - loss: 0.0648
Epoch 336/1000
50/50 [==============================] - 0s - loss: 0.0643
Epoch 337/1000
50/50 [==============================] - 0s - loss: 0.0639
Epoch 338/1000
50/50 [==============================] - 0s - loss: 0.0635
Epoch 339/1000
50/50 [==============================] - 0s - loss: 0.0631
Epoch 340/1000
50/50 [==============================] - 0s - loss: 0.0627
Epoch 341/1000
50/50 [==============================] - 0s - loss: 0.0623
Epoch 342/1000
50/50 [==============================] - 0s - loss: 0.0619
Epoch 343/1000
50/50 [==============================] - 0s - loss: 0.0615
Epoch 344/1000
50/50 [==============================] - 0s - loss: 0.0611
Epoch 345/1000
50/50 [==============================] - 0s - loss: 0.0608
Epoch 346/1000
50/50 [==============================] - 0s - loss: 0.0604
Epoch 347/1000
50/50 [==============================] - 0s - loss: 0.0600
Epoch 348/1000
50/50 [==============================] - 0s - loss: 0.0596
Epoch 349/1000
50/50 [==============================] - 0s - loss: 0.0592
Epoch 350/1000
50/50 [==============================] - 0s - loss: 0.0589
Epoch 351/1000
50/50 [==============================] - 0s - loss: 0.0585
Epoch 352/1000
50/50 [==============================] - 0s - loss: 0.0581
Epoch 353/1000
50/50 [==============================] - 0s - loss: 0.0578
Epoch 354/1000
50/50 [==============================] - 0s - loss: 0.0574
Epoch 355/1000
50/50 [==============================] - 0s - loss: 0.0570
Epoch 356/1000
50/50 [==============================] - 0s - loss: 0.0567
Epoch 357/1000
50/50 [==============================] - 0s - loss: 0.0563
Epoch 358/1000
50/50 [==============================] - 0s - loss: 0.0560
Epoch 359/1000
50/50 [==============================] - 0s - loss: 0.0556
Epoch 360/1000
50/50 [==============================] - 0s - loss: 0.0553
Epoch 361/1000
50/50 [==============================] - 0s - loss: 0.0549
Epoch 362/1000
50/50 [==============================] - 0s - loss: 0.0546
Epoch 363/1000
50/50 [==============================] - 0s - loss: 0.0542
Epoch 364/1000
50/50 [==============================] - 0s - loss: 0.0539
Epoch 365/1000
50/50 [==============================] - 0s - loss: 0.0536
Epoch 366/1000
50/50 [==============================] - 0s - loss: 0.0532
Epoch 367/1000
50/50 [==============================] - 0s - loss: 0.0529
Epoch 368/1000
50/50 [==============================] - 0s - loss: 0.0526
Epoch 369/1000
50/50 [==============================] - 0s - loss: 0.0522
Epoch 370/1000
50/50 [==============================] - 0s - loss: 0.0519
Epoch 371/1000
50/50 [==============================] - 0s - loss: 0.0516
Epoch 372/1000
50/50 [==============================] - 0s - loss: 0.0513
Epoch 373/1000
50/50 [==============================] - 0s - loss: 0.0509
Epoch 374/1000
50/50 [==============================] - 0s - loss: 0.0506
Epoch 375/1000
50/50 [==============================] - 0s - loss: 0.0503
Epoch 376/1000
50/50 [==============================] - 0s - loss: 0.0500
Epoch 377/1000
50/50 [==============================] - 0s - loss: 0.0497
Epoch 378/1000
50/50 [==============================] - 0s - loss: 0.0494
Epoch 379/1000
50/50 [==============================] - 0s - loss: 0.0491
Epoch 380/1000
50/50 [==============================] - 0s - loss: 0.0488
Epoch 381/1000
50/50 [==============================] - 0s - loss: 0.0485
Epoch 382/1000
50/50 [==============================] - 0s - loss: 0.0482
Epoch 383/1000
50/50 [==============================] - 0s - loss: 0.0479
Epoch 384/1000
50/50 [==============================] - 0s - loss: 0.0476
Epoch 385/1000
50/50 [==============================] - 0s - loss: 0.0473
Epoch 386/1000
50/50 [==============================] - 0s - loss: 0.0470
Epoch 387/1000
50/50 [==============================] - 0s - loss: 0.0467
Epoch 388/1000
50/50 [==============================] - 0s - loss: 0.0464
Epoch 389/1000
50/50 [==============================] - 0s - loss: 0.0461
Epoch 390/1000
50/50 [==============================] - 0s - loss: 0.0458
Epoch 391/1000
50/50 [==============================] - 0s - loss: 0.0455
Epoch 392/1000
50/50 [==============================] - 0s - loss: 0.0453
Epoch 393/1000
50/50 [==============================] - 0s - loss: 0.0450
Epoch 394/1000
50/50 [==============================] - 0s - loss: 0.0447
Epoch 395/1000
50/50 [==============================] - 0s - loss: 0.0444
Epoch 396/1000
50/50 [==============================] - 0s - loss: 0.0442
Epoch 397/1000
50/50 [==============================] - 0s - loss: 0.0439
Epoch 398/1000
50/50 [==============================] - 0s - loss: 0.0436
Epoch 399/1000
50/50 [==============================] - 0s - loss: 0.0433
Epoch 400/1000
50/50 [==============================] - 0s - loss: 0.0431
Epoch 401/1000
50/50 [==============================] - 0s - loss: 0.0428
Epoch 402/1000
50/50 [==============================] - 0s - loss: 0.0426
Epoch 403/1000
50/50 [==============================] - 0s - loss: 0.0423
Epoch 404/1000
50/50 [==============================] - 0s - loss: 0.0420
Epoch 405/1000
50/50 [==============================] - 0s - loss: 0.0418
Epoch 406/1000
50/50 [==============================] - 0s - loss: 0.0415
Epoch 407/1000
50/50 [==============================] - 0s - loss: 0.0413
Epoch 408/1000
50/50 [==============================] - 0s - loss: 0.0410
Epoch 409/1000
50/50 [==============================] - 0s - loss: 0.0408
Epoch 410/1000
50/50 [==============================] - 0s - loss: 0.0405
Epoch 411/1000
50/50 [==============================] - 0s - loss: 0.0403
Epoch 412/1000
50/50 [==============================] - 0s - loss: 0.0400
Epoch 413/1000
50/50 [==============================] - 0s - loss: 0.0398
Epoch 414/1000
50/50 [==============================] - 0s - loss: 0.0395
Epoch 415/1000
50/50 [==============================] - 0s - loss: 0.0393
Epoch 416/1000
50/50 [==============================] - 0s - loss: 0.0391
Epoch 417/1000
50/50 [==============================] - 0s - loss: 0.0388
Epoch 418/1000
50/50 [==============================] - 0s - loss: 0.0386
Epoch 419/1000
50/50 [==============================] - 0s - loss: 0.0383
Epoch 420/1000
50/50 [==============================] - 0s - loss: 0.0381
Epoch 421/1000
50/50 [==============================] - 0s - loss: 0.0379
Epoch 422/1000
50/50 [==============================] - 0s - loss: 0.0376
Epoch 423/1000
50/50 [==============================] - 0s - loss: 0.0374
Epoch 424/1000
50/50 [==============================] - 0s - loss: 0.0372
Epoch 425/1000
50/50 [==============================] - 0s - loss: 0.0370
Epoch 426/1000
50/50 [==============================] - 0s - loss: 0.0367
Epoch 427/1000
50/50 [==============================] - 0s - loss: 0.0365
Epoch 428/1000
50/50 [==============================] - 0s - loss: 0.0363
Epoch 429/1000
50/50 [==============================] - 0s - loss: 0.0361
Epoch 430/1000
50/50 [==============================] - 0s - loss: 0.0359
Epoch 431/1000
50/50 [==============================] - 0s - loss: 0.0356
Epoch 432/1000
50/50 [==============================] - 0s - loss: 0.0354
Epoch 433/1000
50/50 [==============================] - 0s - loss: 0.0352
Epoch 434/1000
50/50 [==============================] - 0s - loss: 0.0350
Epoch 435/1000
50/50 [==============================] - 0s - loss: 0.0348
Epoch 436/1000
50/50 [==============================] - 0s - loss: 0.0346
Epoch 437/1000
50/50 [==============================] - 0s - loss: 0.0344
Epoch 438/1000
50/50 [==============================] - 0s - loss: 0.0342
Epoch 439/1000
50/50 [==============================] - 0s - loss: 0.0340
Epoch 440/1000
50/50 [==============================] - 0s - loss: 0.0337
Epoch 441/1000
50/50 [==============================] - 0s - loss: 0.0335
Epoch 442/1000
50/50 [==============================] - 0s - loss: 0.0333
Epoch 443/1000
50/50 [==============================] - 0s - loss: 0.0331
Epoch 444/1000
50/50 [==============================] - 0s - loss: 0.0329
Epoch 445/1000
50/50 [==============================] - 0s - loss: 0.0327
Epoch 446/1000
50/50 [==============================] - 0s - loss: 0.0325
Epoch 447/1000
50/50 [==============================] - 0s - loss: 0.0323
Epoch 448/1000
50/50 [==============================] - 0s - loss: 0.0322
Epoch 449/1000
50/50 [==============================] - 0s - loss: 0.0320
Epoch 450/1000
50/50 [==============================] - 0s - loss: 0.0318
Epoch 451/1000
50/50 [==============================] - 0s - loss: 0.0316
Epoch 452/1000
50/50 [==============================] - 0s - loss: 0.0314
Epoch 453/1000
50/50 [==============================] - 0s - loss: 0.0312
Epoch 454/1000
50/50 [==============================] - 0s - loss: 0.0310
Epoch 455/1000
50/50 [==============================] - 0s - loss: 0.0308
Epoch 456/1000
50/50 [==============================] - 0s - loss: 0.0306
Epoch 457/1000
50/50 [==============================] - 0s - loss: 0.0304
Epoch 458/1000
50/50 [==============================] - 0s - loss: 0.0303
Epoch 459/1000
50/50 [==============================] - 0s - loss: 0.0301
Epoch 460/1000
50/50 [==============================] - 0s - loss: 0.0299
Epoch 461/1000
50/50 [==============================] - 0s - loss: 0.0297
Epoch 462/1000
50/50 [==============================] - 0s - loss: 0.0295
Epoch 463/1000
50/50 [==============================] - 0s - loss: 0.0294
Epoch 464/1000
50/50 [==============================] - 0s - loss: 0.0292
Epoch 465/1000
50/50 [==============================] - 0s - loss: 0.0290
Epoch 466/1000
50/50 [==============================] - 0s - loss: 0.0288
Epoch 467/1000
50/50 [==============================] - 0s - loss: 0.0287
Epoch 468/1000
50/50 [==============================] - 0s - loss: 0.0285
Epoch 469/1000
50/50 [==============================] - 0s - loss: 0.0283
Epoch 470/1000
50/50 [==============================] - 0s - loss: 0.0282
Epoch 471/1000
50/50 [==============================] - 0s - loss: 0.0280
Epoch 472/1000
50/50 [==============================] - 0s - loss: 0.0278
Epoch 473/1000
50/50 [==============================] - 0s - loss: 0.0277
Epoch 474/1000
50/50 [==============================] - 0s - loss: 0.0275
Epoch 475/1000
50/50 [==============================] - 0s - loss: 0.0273
Epoch 476/1000
50/50 [==============================] - 0s - loss: 0.0272
Epoch 477/1000
50/50 [==============================] - 0s - loss: 0.0270
Epoch 478/1000
50/50 [==============================] - 0s - loss: 0.0268
Epoch 479/1000
50/50 [==============================] - 0s - loss: 0.0267
Epoch 480/1000
50/50 [==============================] - 0s - loss: 0.0265
Epoch 481/1000
50/50 [==============================] - 0s - loss: 0.0264
Epoch 482/1000
50/50 [==============================] - 0s - loss: 0.0262
Epoch 483/1000
50/50 [==============================] - 0s - loss: 0.0260
Epoch 484/1000
50/50 [==============================] - 0s - loss: 0.0259
Epoch 485/1000
50/50 [==============================] - 0s - loss: 0.0257
Epoch 486/1000
50/50 [==============================] - 0s - loss: 0.0256
Epoch 487/1000
50/50 [==============================] - 0s - loss: 0.0254
Epoch 488/1000
50/50 [==============================] - 0s - loss: 0.0253
Epoch 489/1000
50/50 [==============================] - 0s - loss: 0.0251
Epoch 490/1000
50/50 [==============================] - 0s - loss: 0.0250
Epoch 491/1000
50/50 [==============================] - 0s - loss: 0.0248
Epoch 492/1000
50/50 [==============================] - 0s - loss: 0.0247
Epoch 493/1000
50/50 [==============================] - 0s - loss: 0.0245
Epoch 494/1000
50/50 [==============================] - 0s - loss: 0.0244
Epoch 495/1000
50/50 [==============================] - 0s - loss: 0.0242
Epoch 496/1000
50/50 [==============================] - 0s - loss: 0.0241
Epoch 497/1000
50/50 [==============================] - 0s - loss: 0.0239
Epoch 498/1000
50/50 [==============================] - 0s - loss: 0.0238
Epoch 499/1000
50/50 [==============================] - 0s - loss: 0.0237
Epoch 500/1000
50/50 [==============================] - 0s - loss: 0.0235
Epoch 501/1000
50/50 [==============================] - 0s - loss: 0.0234
Epoch 502/1000
50/50 [==============================] - 0s - loss: 0.0232
Epoch 503/1000
50/50 [==============================] - 0s - loss: 0.0231
Epoch 504/1000
50/50 [==============================] - 0s - loss: 0.0230
Epoch 505/1000
50/50 [==============================] - 0s - loss: 0.0228
Epoch 506/1000
50/50 [==============================] - 0s - loss: 0.0227
Epoch 507/1000
50/50 [==============================] - 0s - loss: 0.0226
Epoch 508/1000
50/50 [==============================] - 0s - loss: 0.0224
Epoch 509/1000
50/50 [==============================] - 0s - loss: 0.0223
Epoch 510/1000
50/50 [==============================] - 0s - loss: 0.0222
Epoch 511/1000
50/50 [==============================] - 0s - loss: 0.0220
Epoch 512/1000
50/50 [==============================] - 0s - loss: 0.0219
Epoch 513/1000
50/50 [==============================] - 0s - loss: 0.0218
Epoch 514/1000
50/50 [==============================] - 0s - loss: 0.0216
Epoch 515/1000
50/50 [==============================] - 0s - loss: 0.0215
Epoch 516/1000
50/50 [==============================] - 0s - loss: 0.0214
Epoch 517/1000
50/50 [==============================] - 0s - loss: 0.0212
Epoch 518/1000
50/50 [==============================] - 0s - loss: 0.0211
Epoch 519/1000
50/50 [==============================] - 0s - loss: 0.0210
Epoch 520/1000
50/50 [==============================] - 0s - loss: 0.0209
Epoch 521/1000
50/50 [==============================] - 0s - loss: 0.0207
Epoch 522/1000
50/50 [==============================] - 0s - loss: 0.0206
Epoch 523/1000
50/50 [==============================] - 0s - loss: 0.0205
Epoch 524/1000
50/50 [==============================] - 0s - loss: 0.0204
Epoch 525/1000
50/50 [==============================] - 0s - loss: 0.0203
Epoch 526/1000
50/50 [==============================] - 0s - loss: 0.0201
Epoch 527/1000
50/50 [==============================] - 0s - loss: 0.0200
Epoch 528/1000
50/50 [==============================] - 0s - loss: 0.0199
Epoch 529/1000
50/50 [==============================] - 0s - loss: 0.0198
Epoch 530/1000
50/50 [==============================] - 0s - loss: 0.0197
Epoch 531/1000
50/50 [==============================] - 0s - loss: 0.0195
Epoch 532/1000
50/50 [==============================] - 0s - loss: 0.0194
Epoch 533/1000
50/50 [==============================] - 0s - loss: 0.0193
Epoch 534/1000
50/50 [==============================] - 0s - loss: 0.0192
Epoch 535/1000
50/50 [==============================] - 0s - loss: 0.0191
Epoch 536/1000
50/50 [==============================] - 0s - loss: 0.0190
Epoch 537/1000
50/50 [==============================] - 0s - loss: 0.0189
Epoch 538/1000
50/50 [==============================] - 0s - loss: 0.0187
Epoch 539/1000
50/50 [==============================] - 0s - loss: 0.0186
Epoch 540/1000
50/50 [==============================] - 0s - loss: 0.0185
Epoch 541/1000
50/50 [==============================] - 0s - loss: 0.0184
Epoch 542/1000
50/50 [==============================] - 0s - loss: 0.0183
Epoch 543/1000
50/50 [==============================] - 0s - loss: 0.0182
Epoch 544/1000
50/50 [==============================] - 0s - loss: 0.0181
Epoch 545/1000
50/50 [==============================] - 0s - loss: 0.0180
Epoch 546/1000
50/50 [==============================] - 0s - loss: 0.0179
Epoch 547/1000
50/50 [==============================] - 0s - loss: 0.0178
Epoch 548/1000
50/50 [==============================] - 0s - loss: 0.0177
Epoch 549/1000
50/50 [==============================] - 0s - loss: 0.0175
Epoch 550/1000
50/50 [==============================] - 0s - loss: 0.0174
Epoch 551/1000
50/50 [==============================] - 0s - loss: 0.0173
Epoch 552/1000
50/50 [==============================] - 0s - loss: 0.0172
Epoch 553/1000
50/50 [==============================] - 0s - loss: 0.0171
Epoch 554/1000
50/50 [==============================] - 0s - loss: 0.0170
Epoch 555/1000
50/50 [==============================] - 0s - loss: 0.0169
Epoch 556/1000
50/50 [==============================] - 0s - loss: 0.0168
Epoch 557/1000
50/50 [==============================] - 0s - loss: 0.0167
Epoch 558/1000
50/50 [==============================] - 0s - loss: 0.0166
Epoch 559/1000
50/50 [==============================] - 0s - loss: 0.0165
Epoch 560/1000
50/50 [==============================] - 0s - loss: 0.0164
Epoch 561/1000
50/50 [==============================] - 0s - loss: 0.0163
Epoch 562/1000
50/50 [==============================] - 0s - loss: 0.0162
Epoch 563/1000
50/50 [==============================] - 0s - loss: 0.0161
Epoch 564/1000
50/50 [==============================] - 0s - loss: 0.0160
Epoch 565/1000
50/50 [==============================] - 0s - loss: 0.0160
Epoch 566/1000
50/50 [==============================] - 0s - loss: 0.0159
Epoch 567/1000
50/50 [==============================] - 0s - loss: 0.0158
Epoch 568/1000
50/50 [==============================] - 0s - loss: 0.0157
Epoch 569/1000
50/50 [==============================] - 0s - loss: 0.0156
Epoch 570/1000
50/50 [==============================] - 0s - loss: 0.0155
Epoch 571/1000
50/50 [==============================] - 0s - loss: 0.0154
Epoch 572/1000
50/50 [==============================] - 0s - loss: 0.0153
Epoch 573/1000
50/50 [==============================] - 0s - loss: 0.0152
Epoch 574/1000
50/50 [==============================] - 0s - loss: 0.0151
Epoch 575/1000
50/50 [==============================] - 0s - loss: 0.0150
Epoch 576/1000
50/50 [==============================] - 0s - loss: 0.0149
Epoch 577/1000
50/50 [==============================] - 0s - loss: 0.0148
Epoch 578/1000
50/50 [==============================] - 0s - loss: 0.0148
Epoch 579/1000
50/50 [==============================] - 0s - loss: 0.0147
Epoch 580/1000
50/50 [==============================] - 0s - loss: 0.0146
Epoch 581/1000
50/50 [==============================] - 0s - loss: 0.0145
Epoch 582/1000
50/50 [==============================] - 0s - loss: 0.0144
Epoch 583/1000
50/50 [==============================] - 0s - loss: 0.0143
Epoch 584/1000
50/50 [==============================] - 0s - loss: 0.0142
Epoch 585/1000
50/50 [==============================] - 0s - loss: 0.0142
Epoch 586/1000
50/50 [==============================] - 0s - loss: 0.0141
Epoch 587/1000
50/50 [==============================] - 0s - loss: 0.0140
Epoch 588/1000
50/50 [==============================] - 0s - loss: 0.0139
Epoch 589/1000
50/50 [==============================] - 0s - loss: 0.0138
Epoch 590/1000
50/50 [==============================] - 0s - loss: 0.0137
Epoch 591/1000
50/50 [==============================] - 0s - loss: 0.0137
Epoch 592/1000
50/50 [==============================] - 0s - loss: 0.0136
Epoch 593/1000
50/50 [==============================] - 0s - loss: 0.0135
Epoch 594/1000
50/50 [==============================] - 0s - loss: 0.0134
Epoch 595/1000
50/50 [==============================] - 0s - loss: 0.0133
Epoch 596/1000
50/50 [==============================] - 0s - loss: 0.0133
Epoch 597/1000
50/50 [==============================] - 0s - loss: 0.0132
Epoch 598/1000
50/50 [==============================] - 0s - loss: 0.0131
Epoch 599/1000
50/50 [==============================] - 0s - loss: 0.0130
Epoch 600/1000
50/50 [==============================] - 0s - loss: 0.0129
Epoch 601/1000
50/50 [==============================] - 0s - loss: 0.0129
Epoch 602/1000
50/50 [==============================] - 0s - loss: 0.0128
Epoch 603/1000
50/50 [==============================] - 0s - loss: 0.0127
Epoch 604/1000
50/50 [==============================] - 0s - loss: 0.0126
Epoch 605/1000
50/50 [==============================] - 0s - loss: 0.0126
Epoch 606/1000
50/50 [==============================] - 0s - loss: 0.0125
Epoch 607/1000
50/50 [==============================] - 0s - loss: 0.0124
Epoch 608/1000
50/50 [==============================] - 0s - loss: 0.0123
Epoch 609/1000
50/50 [==============================] - 0s - loss: 0.0123
Epoch 610/1000
50/50 [==============================] - 0s - loss: 0.0122
Epoch 611/1000
50/50 [==============================] - 0s - loss: 0.0121
Epoch 612/1000
50/50 [==============================] - 0s - loss: 0.0121
Epoch 613/1000
50/50 [==============================] - 0s - loss: 0.0120
Epoch 614/1000
50/50 [==============================] - 0s - loss: 0.0119
Epoch 615/1000
50/50 [==============================] - 0s - loss: 0.0118
Epoch 616/1000
50/50 [==============================] - 0s - loss: 0.0118
Epoch 617/1000
50/50 [==============================] - 0s - loss: 0.0117
Epoch 618/1000
50/50 [==============================] - 0s - loss: 0.0116
Epoch 619/1000
50/50 [==============================] - 0s - loss: 0.0116
Epoch 620/1000
50/50 [==============================] - 0s - loss: 0.0115
Epoch 621/1000
50/50 [==============================] - 0s - loss: 0.0114
Epoch 622/1000
50/50 [==============================] - 0s - loss: 0.0114
Epoch 623/1000
50/50 [==============================] - 0s - loss: 0.0113
Epoch 624/1000
50/50 [==============================] - 0s - loss: 0.0112
Epoch 625/1000
50/50 [==============================] - 0s - loss: 0.0112
Epoch 626/1000
50/50 [==============================] - 0s - loss: 0.0111
Epoch 627/1000
50/50 [==============================] - 0s - loss: 0.0110
Epoch 628/1000
50/50 [==============================] - 0s - loss: 0.0110
Epoch 629/1000
50/50 [==============================] - 0s - loss: 0.0109
Epoch 630/1000
50/50 [==============================] - 0s - loss: 0.0108
Epoch 631/1000
50/50 [==============================] - 0s - loss: 0.0108
Epoch 632/1000
50/50 [==============================] - 0s - loss: 0.0107
Epoch 633/1000
50/50 [==============================] - 0s - loss: 0.0106
Epoch 634/1000
50/50 [==============================] - 0s - loss: 0.0106
Epoch 635/1000
50/50 [==============================] - 0s - loss: 0.0105
Epoch 636/1000
50/50 [==============================] - 0s - loss: 0.0104
Epoch 637/1000
50/50 [==============================] - 0s - loss: 0.0104
Epoch 638/1000
50/50 [==============================] - 0s - loss: 0.0103
Epoch 639/1000
50/50 [==============================] - 0s - loss: 0.0103
Epoch 640/1000
50/50 [==============================] - 0s - loss: 0.0102
Epoch 641/1000
50/50 [==============================] - 0s - loss: 0.0101
Epoch 642/1000
50/50 [==============================] - 0s - loss: 0.0101
Epoch 643/1000
50/50 [==============================] - 0s - loss: 0.0100
Epoch 644/1000
50/50 [==============================] - 0s - loss: 0.0100
Epoch 645/1000
50/50 [==============================] - 0s - loss: 0.0099
Epoch 646/1000
50/50 [==============================] - 0s - loss: 0.0098
Epoch 647/1000
50/50 [==============================] - 0s - loss: 0.0098
Epoch 648/1000
50/50 [==============================] - 0s - loss: 0.0097
Epoch 649/1000
50/50 [==============================] - 0s - loss: 0.0097
Epoch 650/1000
50/50 [==============================] - 0s - loss: 0.0096
Epoch 651/1000
50/50 [==============================] - 0s - loss: 0.0095
Epoch 652/1000
50/50 [==============================] - 0s - loss: 0.0095
Epoch 653/1000
50/50 [==============================] - 0s - loss: 0.0094
Epoch 654/1000
50/50 [==============================] - 0s - loss: 0.0094
Epoch 655/1000
50/50 [==============================] - 0s - loss: 0.0093
Epoch 656/1000
50/50 [==============================] - 0s - loss: 0.0093
Epoch 657/1000
50/50 [==============================] - 0s - loss: 0.0092
Epoch 658/1000
50/50 [==============================] - 0s - loss: 0.0092
Epoch 659/1000
50/50 [==============================] - 0s - loss: 0.0091
Epoch 660/1000
50/50 [==============================] - 0s - loss: 0.0090
Epoch 661/1000
50/50 [==============================] - 0s - loss: 0.0090
Epoch 662/1000
50/50 [==============================] - 0s - loss: 0.0089
Epoch 663/1000
50/50 [==============================] - 0s - loss: 0.0089
Epoch 664/1000
50/50 [==============================] - 0s - loss: 0.0088
Epoch 665/1000
50/50 [==============================] - 0s - loss: 0.0088
Epoch 666/1000
50/50 [==============================] - 0s - loss: 0.0087
Epoch 667/1000
50/50 [==============================] - 0s - loss: 0.0087
Epoch 668/1000
50/50 [==============================] - 0s - loss: 0.0086
Epoch 669/1000
50/50 [==============================] - 0s - loss: 0.0086
Epoch 670/1000
50/50 [==============================] - 0s - loss: 0.0085
Epoch 671/1000
50/50 [==============================] - 0s - loss: 0.0085
Epoch 672/1000
50/50 [==============================] - 0s - loss: 0.0084
Epoch 673/1000
50/50 [==============================] - 0s - loss: 0.0084
Epoch 674/1000
50/50 [==============================] - 0s - loss: 0.0083
Epoch 675/1000
50/50 [==============================] - 0s - loss: 0.0083
Epoch 676/1000
50/50 [==============================] - 0s - loss: 0.0082
Epoch 677/1000
50/50 [==============================] - 0s - loss: 0.0082
Epoch 678/1000
50/50 [==============================] - 0s - loss: 0.0081
Epoch 679/1000
50/50 [==============================] - 0s - loss: 0.0081
Epoch 680/1000
50/50 [==============================] - 0s - loss: 0.0080
Epoch 681/1000
50/50 [==============================] - 0s - loss: 0.0080
Epoch 682/1000
50/50 [==============================] - 0s - loss: 0.0079
Epoch 683/1000
50/50 [==============================] - 0s - loss: 0.0079
Epoch 684/1000
50/50 [==============================] - 0s - loss: 0.0078
Epoch 685/1000
50/50 [==============================] - 0s - loss: 0.0078
Epoch 686/1000
50/50 [==============================] - 0s - loss: 0.0077
Epoch 687/1000
50/50 [==============================] - 0s - loss: 0.0077
Epoch 688/1000
50/50 [==============================] - 0s - loss: 0.0077
Epoch 689/1000
50/50 [==============================] - 0s - loss: 0.0076
Epoch 690/1000
50/50 [==============================] - 0s - loss: 0.0076
Epoch 691/1000
50/50 [==============================] - 0s - loss: 0.0075
Epoch 692/1000
50/50 [==============================] - 0s - loss: 0.0075
Epoch 693/1000
50/50 [==============================] - 0s - loss: 0.0074
Epoch 694/1000
50/50 [==============================] - 0s - loss: 0.0074
Epoch 695/1000
50/50 [==============================] - 0s - loss: 0.0073
Epoch 696/1000
50/50 [==============================] - 0s - loss: 0.0073
Epoch 697/1000
50/50 [==============================] - 0s - loss: 0.0073
Epoch 698/1000
50/50 [==============================] - 0s - loss: 0.0072
Epoch 699/1000
50/50 [==============================] - 0s - loss: 0.0072
Epoch 700/1000
50/50 [==============================] - 0s - loss: 0.0071
Epoch 701/1000
50/50 [==============================] - 0s - loss: 0.0071
Epoch 702/1000
50/50 [==============================] - 0s - loss: 0.0070
Epoch 703/1000
50/50 [==============================] - 0s - loss: 0.0070
Epoch 704/1000
50/50 [==============================] - 0s - loss: 0.0070
Epoch 705/1000
50/50 [==============================] - 0s - loss: 0.0069
Epoch 706/1000
50/50 [==============================] - 0s - loss: 0.0069
Epoch 707/1000
50/50 [==============================] - 0s - loss: 0.0068
Epoch 708/1000
50/50 [==============================] - 0s - loss: 0.0068
Epoch 709/1000
50/50 [==============================] - 0s - loss: 0.0068
Epoch 710/1000
50/50 [==============================] - 0s - loss: 0.0067
Epoch 711/1000
50/50 [==============================] - 0s - loss: 0.0067
Epoch 712/1000
50/50 [==============================] - 0s - loss: 0.0066
Epoch 713/1000
50/50 [==============================] - 0s - loss: 0.0066
Epoch 714/1000
50/50 [==============================] - 0s - loss: 0.0066
Epoch 715/1000
50/50 [==============================] - 0s - loss: 0.0065
Epoch 716/1000
50/50 [==============================] - 0s - loss: 0.0065
Epoch 717/1000
50/50 [==============================] - 0s - loss: 0.0064
Epoch 718/1000
50/50 [==============================] - 0s - loss: 0.0064
Epoch 719/1000
50/50 [==============================] - 0s - loss: 0.0064
Epoch 720/1000
50/50 [==============================] - 0s - loss: 0.0063
Epoch 721/1000
50/50 [==============================] - 0s - loss: 0.0063
Epoch 722/1000
50/50 [==============================] - 0s - loss: 0.0062
Epoch 723/1000
50/50 [==============================] - 0s - loss: 0.0062
Epoch 724/1000
50/50 [==============================] - 0s - loss: 0.0062
Epoch 725/1000
50/50 [==============================] - 0s - loss: 0.0061
Epoch 726/1000
50/50 [==============================] - 0s - loss: 0.0061
Epoch 727/1000
50/50 [==============================] - 0s - loss: 0.0061
Epoch 728/1000
50/50 [==============================] - 0s - loss: 0.0060
Epoch 729/1000
50/50 [==============================] - 0s - loss: 0.0060
Epoch 730/1000
50/50 [==============================] - 0s - loss: 0.0060
Epoch 731/1000
50/50 [==============================] - 0s - loss: 0.0059
Epoch 732/1000
50/50 [==============================] - 0s - loss: 0.0059
Epoch 733/1000
50/50 [==============================] - 0s - loss: 0.0059
Epoch 734/1000
50/50 [==============================] - 0s - loss: 0.0058
Epoch 735/1000
50/50 [==============================] - 0s - loss: 0.0058
Epoch 736/1000
50/50 [==============================] - 0s - loss: 0.0057
Epoch 737/1000
50/50 [==============================] - 0s - loss: 0.0057
Epoch 738/1000
50/50 [==============================] - 0s - loss: 0.0057
Epoch 739/1000
50/50 [==============================] - 0s - loss: 0.0056
Epoch 740/1000
50/50 [==============================] - 0s - loss: 0.0056
Epoch 741/1000
50/50 [==============================] - 0s - loss: 0.0056
Epoch 742/1000
50/50 [==============================] - 0s - loss: 0.0055
Epoch 743/1000
50/50 [==============================] - 0s - loss: 0.0055
Epoch 744/1000
50/50 [==============================] - 0s - loss: 0.0055
Epoch 745/1000
50/50 [==============================] - 0s - loss: 0.0054
Epoch 746/1000
50/50 [==============================] - 0s - loss: 0.0054
Epoch 747/1000
50/50 [==============================] - 0s - loss: 0.0054
Epoch 748/1000
50/50 [==============================] - 0s - loss: 0.0053
Epoch 749/1000
50/50 [==============================] - 0s - loss: 0.0053
Epoch 750/1000
50/50 [==============================] - 0s - loss: 0.0053
Epoch 751/1000
50/50 [==============================] - 0s - loss: 0.0053
Epoch 752/1000
50/50 [==============================] - 0s - loss: 0.0052
Epoch 753/1000
50/50 [==============================] - 0s - loss: 0.0052
Epoch 754/1000
50/50 [==============================] - 0s - loss: 0.0052
Epoch 755/1000
50/50 [==============================] - 0s - loss: 0.0051
Epoch 756/1000
50/50 [==============================] - 0s - loss: 0.0051
Epoch 757/1000
50/50 [==============================] - 0s - loss: 0.0051
Epoch 758/1000
50/50 [==============================] - 0s - loss: 0.0050
Epoch 759/1000
50/50 [==============================] - 0s - loss: 0.0050
Epoch 760/1000
50/50 [==============================] - 0s - loss: 0.0050
Epoch 761/1000
50/50 [==============================] - 0s - loss: 0.0049
Epoch 762/1000
50/50 [==============================] - 0s - loss: 0.0049
Epoch 763/1000
50/50 [==============================] - 0s - loss: 0.0049
Epoch 764/1000
50/50 [==============================] - 0s - loss: 0.0049
Epoch 765/1000
50/50 [==============================] - 0s - loss: 0.0048
Epoch 766/1000
50/50 [==============================] - 0s - loss: 0.0048
Epoch 767/1000
50/50 [==============================] - 0s - loss: 0.0048
Epoch 768/1000
50/50 [==============================] - 0s - loss: 0.0047
Epoch 769/1000
50/50 [==============================] - 0s - loss: 0.0047
Epoch 770/1000
50/50 [==============================] - 0s - loss: 0.0047
Epoch 771/1000
50/50 [==============================] - 0s - loss: 0.0047
Epoch 772/1000
50/50 [==============================] - 0s - loss: 0.0046
Epoch 773/1000
50/50 [==============================] - 0s - loss: 0.0046
Epoch 774/1000
50/50 [==============================] - 0s - loss: 0.0046
Epoch 775/1000
50/50 [==============================] - 0s - loss: 0.0046
Epoch 776/1000
50/50 [==============================] - 0s - loss: 0.0045
Epoch 777/1000
50/50 [==============================] - 0s - loss: 0.0045
Epoch 778/1000
50/50 [==============================] - 0s - loss: 0.0045
Epoch 779/1000
50/50 [==============================] - 0s - loss: 0.0044
Epoch 780/1000
50/50 [==============================] - 0s - loss: 0.0044
Epoch 781/1000
50/50 [==============================] - 0s - loss: 0.0044
Epoch 782/1000
50/50 [==============================] - 0s - loss: 0.0044
Epoch 783/1000
50/50 [==============================] - 0s - loss: 0.0043
Epoch 784/1000
50/50 [==============================] - 0s - loss: 0.0043
Epoch 785/1000
50/50 [==============================] - 0s - loss: 0.0043
Epoch 786/1000
50/50 [==============================] - 0s - loss: 0.0043
Epoch 787/1000
50/50 [==============================] - 0s - loss: 0.0042
Epoch 788/1000
50/50 [==============================] - 0s - loss: 0.0042
Epoch 789/1000
50/50 [==============================] - 0s - loss: 0.0042
Epoch 790/1000
50/50 [==============================] - 0s - loss: 0.0042
Epoch 791/1000
50/50 [==============================] - 0s - loss: 0.0041
Epoch 792/1000
50/50 [==============================] - 0s - loss: 0.0041
Epoch 793/1000
50/50 [==============================] - 0s - loss: 0.0041
Epoch 794/1000
50/50 [==============================] - 0s - loss: 0.0041
Epoch 795/1000
50/50 [==============================] - 0s - loss: 0.0040
Epoch 796/1000
50/50 [==============================] - 0s - loss: 0.0040
Epoch 797/1000
50/50 [==============================] - 0s - loss: 0.0040
Epoch 798/1000
50/50 [==============================] - 0s - loss: 0.0040
Epoch 799/1000
50/50 [==============================] - 0s - loss: 0.0039
Epoch 800/1000
50/50 [==============================] - 0s - loss: 0.0039
Epoch 801/1000
50/50 [==============================] - 0s - loss: 0.0039
Epoch 802/1000
50/50 [==============================] - 0s - loss: 0.0039
Epoch 803/1000
50/50 [==============================] - 0s - loss: 0.0038
Epoch 804/1000
50/50 [==============================] - 0s - loss: 0.0038
Epoch 805/1000
50/50 [==============================] - 0s - loss: 0.0038
Epoch 806/1000
50/50 [==============================] - 0s - loss: 0.0038
Epoch 807/1000
50/50 [==============================] - 0s - loss: 0.0038
Epoch 808/1000
50/50 [==============================] - 0s - loss: 0.0037
Epoch 809/1000
50/50 [==============================] - 0s - loss: 0.0037
Epoch 810/1000
50/50 [==============================] - 0s - loss: 0.0037
Epoch 811/1000
50/50 [==============================] - 0s - loss: 0.0037
Epoch 812/1000
50/50 [==============================] - 0s - loss: 0.0036
Epoch 813/1000
50/50 [==============================] - 0s - loss: 0.0036
Epoch 814/1000
50/50 [==============================] - 0s - loss: 0.0036
Epoch 815/1000
50/50 [==============================] - 0s - loss: 0.0036
Epoch 816/1000
50/50 [==============================] - 0s - loss: 0.0036
Epoch 817/1000
50/50 [==============================] - 0s - loss: 0.0035
Epoch 818/1000
50/50 [==============================] - 0s - loss: 0.0035
Epoch 819/1000
50/50 [==============================] - 0s - loss: 0.0035
Epoch 820/1000
50/50 [==============================] - 0s - loss: 0.0035
Epoch 821/1000
50/50 [==============================] - 0s - loss: 0.0035
Epoch 822/1000
50/50 [==============================] - 0s - loss: 0.0034
Epoch 823/1000
50/50 [==============================] - 0s - loss: 0.0034
Epoch 824/1000
50/50 [==============================] - 0s - loss: 0.0034
Epoch 825/1000
50/50 [==============================] - 0s - loss: 0.0034
Epoch 826/1000
50/50 [==============================] - 0s - loss: 0.0034
Epoch 827/1000
50/50 [==============================] - 0s - loss: 0.0033
Epoch 828/1000
50/50 [==============================] - 0s - loss: 0.0033
Epoch 829/1000
50/50 [==============================] - 0s - loss: 0.0033
Epoch 830/1000
50/50 [==============================] - 0s - loss: 0.0033
Epoch 831/1000
50/50 [==============================] - 0s - loss: 0.0033
Epoch 832/1000
50/50 [==============================] - 0s - loss: 0.0032
Epoch 833/1000
50/50 [==============================] - 0s - loss: 0.0032
Epoch 834/1000
50/50 [==============================] - 0s - loss: 0.0032
Epoch 835/1000
50/50 [==============================] - 0s - loss: 0.0032
Epoch 836/1000
50/50 [==============================] - 0s - loss: 0.0032
Epoch 837/1000
50/50 [==============================] - 0s - loss: 0.0031
Epoch 838/1000
50/50 [==============================] - 0s - loss: 0.0031
Epoch 839/1000
50/50 [==============================] - 0s - loss: 0.0031
Epoch 840/1000
50/50 [==============================] - 0s - loss: 0.0031
Epoch 841/1000
50/50 [==============================] - 0s - loss: 0.0031
Epoch 842/1000
50/50 [==============================] - 0s - loss: 0.0030
Epoch 843/1000
50/50 [==============================] - 0s - loss: 0.0030
Epoch 844/1000
50/50 [==============================] - 0s - loss: 0.0030
Epoch 845/1000
50/50 [==============================] - 0s - loss: 0.0030
Epoch 846/1000
50/50 [==============================] - 0s - loss: 0.0030
Epoch 847/1000
50/50 [==============================] - 0s - loss: 0.0030
Epoch 848/1000
50/50 [==============================] - 0s - loss: 0.0029
Epoch 849/1000
50/50 [==============================] - 0s - loss: 0.0029
Epoch 850/1000
50/50 [==============================] - 0s - loss: 0.0029
Epoch 851/1000
50/50 [==============================] - 0s - loss: 0.0029
Epoch 852/1000
50/50 [==============================] - 0s - loss: 0.0029
Epoch 853/1000
50/50 [==============================] - 0s - loss: 0.0029
Epoch 854/1000
50/50 [==============================] - 0s - loss: 0.0028
Epoch 855/1000
50/50 [==============================] - 0s - loss: 0.0028
Epoch 856/1000
50/50 [==============================] - 0s - loss: 0.0028
Epoch 857/1000
50/50 [==============================] - 0s - loss: 0.0028
Epoch 858/1000
50/50 [==============================] - 0s - loss: 0.0028
Epoch 859/1000
50/50 [==============================] - 0s - loss: 0.0028
Epoch 860/1000
50/50 [==============================] - 0s - loss: 0.0027
Epoch 861/1000
50/50 [==============================] - 0s - loss: 0.0027
Epoch 862/1000
50/50 [==============================] - 0s - loss: 0.0027
Epoch 863/1000
50/50 [==============================] - 0s - loss: 0.0027
Epoch 864/1000
50/50 [==============================] - 0s - loss: 0.0027
Epoch 865/1000
50/50 [==============================] - 0s - loss: 0.0027
Epoch 866/1000
50/50 [==============================] - 0s - loss: 0.0026
Epoch 867/1000
50/50 [==============================] - 0s - loss: 0.0026
Epoch 868/1000
50/50 [==============================] - 0s - loss: 0.0026
Epoch 869/1000
50/50 [==============================] - 0s - loss: 0.0026
Epoch 870/1000
50/50 [==============================] - 0s - loss: 0.0026
Epoch 871/1000
50/50 [==============================] - 0s - loss: 0.0026
Epoch 872/1000
50/50 [==============================] - 0s - loss: 0.0025
Epoch 873/1000
50/50 [==============================] - 0s - loss: 0.0025
Epoch 874/1000
50/50 [==============================] - 0s - loss: 0.0025
Epoch 875/1000
50/50 [==============================] - 0s - loss: 0.0025
Epoch 876/1000
50/50 [==============================] - 0s - loss: 0.0025
Epoch 877/1000
50/50 [==============================] - 0s - loss: 0.0025
Epoch 878/1000
50/50 [==============================] - 0s - loss: 0.0025
Epoch 879/1000
50/50 [==============================] - 0s - loss: 0.0024
Epoch 880/1000
50/50 [==============================] - 0s - loss: 0.0024
Epoch 881/1000
50/50 [==============================] - 0s - loss: 0.0024
Epoch 882/1000
50/50 [==============================] - 0s - loss: 0.0024
Epoch 883/1000
50/50 [==============================] - 0s - loss: 0.0024
Epoch 884/1000
50/50 [==============================] - 0s - loss: 0.0024
Epoch 885/1000
50/50 [==============================] - 0s - loss: 0.0024
Epoch 886/1000
50/50 [==============================] - 0s - loss: 0.0023
Epoch 887/1000
50/50 [==============================] - 0s - loss: 0.0023
Epoch 888/1000
50/50 [==============================] - 0s - loss: 0.0023
Epoch 889/1000
50/50 [==============================] - 0s - loss: 0.0023
Epoch 890/1000
50/50 [==============================] - 0s - loss: 0.0023
Epoch 891/1000
50/50 [==============================] - 0s - loss: 0.0023
Epoch 892/1000
50/50 [==============================] - 0s - loss: 0.0023
Epoch 893/1000
50/50 [==============================] - 0s - loss: 0.0022
Epoch 894/1000
50/50 [==============================] - 0s - loss: 0.0022
Epoch 895/1000
50/50 [==============================] - 0s - loss: 0.0022
Epoch 896/1000
50/50 [==============================] - 0s - loss: 0.0022
Epoch 897/1000
50/50 [==============================] - 0s - loss: 0.0022
Epoch 898/1000
50/50 [==============================] - 0s - loss: 0.0022
Epoch 899/1000
50/50 [==============================] - 0s - loss: 0.0022
Epoch 900/1000
50/50 [==============================] - 0s - loss: 0.0022
Epoch 901/1000
50/50 [==============================] - 0s - loss: 0.0021
Epoch 902/1000
50/50 [==============================] - 0s - loss: 0.0021
Epoch 903/1000
50/50 [==============================] - 0s - loss: 0.0021
Epoch 904/1000
50/50 [==============================] - 0s - loss: 0.0021
Epoch 905/1000
50/50 [==============================] - 0s - loss: 0.0021
Epoch 906/1000
50/50 [==============================] - 0s - loss: 0.0021
Epoch 907/1000
50/50 [==============================] - 0s - loss: 0.0021
Epoch 908/1000
50/50 [==============================] - 0s - loss: 0.0021
Epoch 909/1000
50/50 [==============================] - 0s - loss: 0.0020
Epoch 910/1000
50/50 [==============================] - 0s - loss: 0.0020
Epoch 911/1000
50/50 [==============================] - 0s - loss: 0.0020
Epoch 912/1000
50/50 [==============================] - 0s - loss: 0.0020
Epoch 913/1000
50/50 [==============================] - 0s - loss: 0.0020
Epoch 914/1000
50/50 [==============================] - 0s - loss: 0.0020
Epoch 915/1000
50/50 [==============================] - 0s - loss: 0.0020
Epoch 916/1000
50/50 [==============================] - 0s - loss: 0.0020
Epoch 917/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 918/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 919/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 920/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 921/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 922/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 923/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 924/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 925/1000
50/50 [==============================] - 0s - loss: 0.0019
Epoch 926/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 927/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 928/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 929/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 930/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 931/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 932/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 933/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 934/1000
50/50 [==============================] - 0s - loss: 0.0018
Epoch 935/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 936/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 937/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 938/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 939/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 940/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 941/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 942/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 943/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 944/1000
50/50 [==============================] - 0s - loss: 0.0017
Epoch 945/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 946/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 947/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 948/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 949/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 950/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 951/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 952/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 953/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 954/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 955/1000
50/50 [==============================] - 0s - loss: 0.0016
Epoch 956/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 957/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 958/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 959/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 960/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 961/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 962/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 963/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 964/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 965/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 966/1000
50/50 [==============================] - 0s - loss: 0.0015
Epoch 967/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 968/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 969/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 970/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 971/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 972/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 973/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 974/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 975/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 976/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 977/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 978/1000
50/50 [==============================] - 0s - loss: 0.0014
Epoch 979/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 980/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 981/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 982/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 983/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 984/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 985/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 986/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 987/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 988/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 989/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 990/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 991/1000
50/50 [==============================] - 0s - loss: 0.0013
Epoch 992/1000
50/50 [==============================] - 0s - loss: 0.0012
Epoch 993/1000
50/50 [==============================] - 0s - loss: 0.0012
Epoch 994/1000
50/50 [==============================] - 0s - loss: 0.0012
Epoch 995/1000
50/50 [==============================] - 0s - loss: 0.0012
Epoch 996/1000
50/50 [==============================] - 0s - loss: 0.0012
Epoch 997/1000
50/50 [==============================] - 0s - loss: 0.0012
Epoch 998/1000
50/50 [==============================] - 0s - loss: 0.0012
Epoch 999/1000
50/50 [==============================] - 0s - loss: 0.0012
Epoch 1000/1000
50/50 [==============================] - 0s - loss: 0.0012










    
Out[8]:








<keras.callbacks.History at 0x10a4bd0b8>

















In [9]:



    


plot(model.predict(x)[0])
plot(x[0])



    


















    
Out[9]:








[<matplotlib.lines.Line2D at 0x10a4bdc88>]










    
























In [10]:



    


plot(model.predict(x)[10])
plot(x[10])



    


















    
Out[10]:








[<matplotlib.lines.Line2D at 0x10a838ba8>]










    
























In [11]:



    


print('last loss:', loss_history.losses[-1])
plot(loss_history.losses);



    


















    






last loss: 0.0011872439874542162










    
























In [12]:



    


imshow(model.get_weights()[0], interpolation='nearest', cmap='gray');



    


















    
























In [13]:



    


imshow(model.get_weights()[2], interpolation='nearest', cmap='gray');

The model should be able to handle noise-corrupted input signal.





In [14]:



    


x_noised = x + 0.2 * np.random.random(len(x[0]))
plot(x_noised[0], label='input')
plot(model.predict(x_noised)[0], label='predicted')
legend();

This time the model should be able to handle also phase-shifted signal since it was trained such.





In [15]:



    


x_shifted = np.cos(2*np.pi/N * t.reshape(1, -1))
plot(x_shifted[0], label='input')
plot(model.predict(x_shifted)[0], label='predicted')
legend();



    


















    
























In [ ]:

Content source: bzamecnik/ml-playground

Similar notebooks:

notebook.community | gallery | about