In [1]:
Using Theano backend.
In [2]:
In [3]:

Trenujemy naszą warstwę BN tak, aby przesuwała o 3.14 pierwszą współrzędną oraz mnożyła przez -0.1 drugą. Poniżej multiplier ma na celu zniwelowanie efektów związanych z nieobciążonym estymatorem dla wariancji.

In [4]:
Epoch 1/500
4000/4000 [==============================] - 0s 1us/step - loss: 9.7232
Epoch 2/500
4000/4000 [==============================] - 0s 2us/step - loss: 4.1890
Epoch 3/500
4000/4000 [==============================] - 0s 4us/step - loss: 1.8037
Epoch 4/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.7780
Epoch 5/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.3351
Epoch 6/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.1491
Epoch 7/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0650
Epoch 8/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0299
Epoch 9/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0122
Epoch 10/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0134
Epoch 11/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0060
Epoch 12/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0027
Epoch 13/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0049
Epoch 14/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0018
Epoch 15/500
4000/4000 [==============================] - 0s 7us/step - loss: 0.0051
Epoch 16/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0026
Epoch 17/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0033
Epoch 18/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0018
Epoch 19/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0080
Epoch 20/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0010
Epoch 21/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0032
Epoch 22/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0065
Epoch 23/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0049
Epoch 24/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0026
Epoch 25/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0048
Epoch 26/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0029
Epoch 27/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0037
Epoch 28/500
4000/4000 [==============================] - 0s 7us/step - loss: 6.5138e-04
Epoch 29/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0038
Epoch 30/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0029
Epoch 31/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0020
Epoch 32/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0027
Epoch 33/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0084
Epoch 34/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0059
Epoch 35/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0027
Epoch 36/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0074
Epoch 37/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0013
Epoch 38/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0072
Epoch 39/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0040
Epoch 40/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0060
Epoch 41/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0099
Epoch 42/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0044
Epoch 43/500
4000/4000 [==============================] - 0s 4us/step - loss: 7.1155e-04
Epoch 44/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0027
Epoch 45/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0056
Epoch 46/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0060
Epoch 47/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0038
Epoch 48/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0048
Epoch 49/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0019
Epoch 50/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0016
Epoch 51/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0040
Epoch 52/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0085
Epoch 53/500
4000/4000 [==============================] - 0s 6us/step - loss: 0.0111
Epoch 54/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0053
Epoch 55/500
4000/4000 [==============================] - 0s 4us/step - loss: 4.9071e-04
Epoch 56/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0029
Epoch 57/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0015
Epoch 58/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0052
Epoch 59/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0056
Epoch 60/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0020
Epoch 61/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0041
Epoch 62/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0076
Epoch 63/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0024
Epoch 64/500
4000/4000 [==============================] - 0s 3us/step - loss: 7.6484e-04
Epoch 65/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0039
Epoch 66/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0028
Epoch 67/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0024
Epoch 68/500
4000/4000 [==============================] - 0s 5us/step - loss: 2.2014e-04
Epoch 69/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0034
Epoch 70/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0049
Epoch 71/500
4000/4000 [==============================] - 0s 3us/step - loss: 9.1043e-04
Epoch 72/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0091
Epoch 73/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0013
Epoch 74/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0053
Epoch 75/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0035
Epoch 76/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0074
Epoch 77/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0014
Epoch 78/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0058
Epoch 79/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0019
Epoch 80/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0039
Epoch 81/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0024
Epoch 82/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0019
Epoch 83/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0066
Epoch 84/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0034
Epoch 85/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0119
Epoch 86/500
4000/4000 [==============================] - 0s 2us/step - loss: 9.3160e-04
Epoch 87/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0039
Epoch 88/500
4000/4000 [==============================] - 0s 3us/step - loss: 5.1111e-04
Epoch 89/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0021
Epoch 90/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0077
Epoch 91/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0012
Epoch 92/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0026
Epoch 93/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0073
Epoch 94/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0029
Epoch 95/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0014
Epoch 96/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0093
Epoch 97/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0079
Epoch 98/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0017
Epoch 99/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0029
Epoch 100/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0021
Epoch 101/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0041
Epoch 102/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0012
Epoch 103/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0011
Epoch 104/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0015
Epoch 105/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0028
Epoch 106/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0029
Epoch 107/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0110
Epoch 108/500
4000/4000 [==============================] - 0s 15us/step - loss: 0.0032
Epoch 109/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0039
Epoch 110/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0043
Epoch 111/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0018
Epoch 112/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0015
Epoch 113/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0027
Epoch 114/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0021
Epoch 115/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0038
Epoch 116/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0086
Epoch 117/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0036
Epoch 118/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0068
Epoch 119/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0087
Epoch 120/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0011
Epoch 121/500
4000/4000 [==============================] - 0s 2us/step - loss: 8.0058e-04
Epoch 122/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0027
Epoch 123/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0036
Epoch 124/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0142
Epoch 125/500
4000/4000 [==============================] - 0s 3us/step - loss: 9.1251e-04
Epoch 126/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0020
Epoch 127/500
4000/4000 [==============================] - 0s 3us/step - loss: 8.0921e-04
Epoch 128/500
4000/4000 [==============================] - 0s 3us/step - loss: 3.3044e-04
Epoch 129/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0046
Epoch 130/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0039
Epoch 131/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0027
Epoch 132/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0039
Epoch 133/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0065
Epoch 134/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0032
Epoch 135/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0037
Epoch 136/500
4000/4000 [==============================] - 0s 3us/step - loss: 3.4301e-04
Epoch 137/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0079
Epoch 138/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0034
Epoch 139/500
4000/4000 [==============================] - 0s 4us/step - loss: 7.4494e-04
Epoch 140/500
4000/4000 [==============================] - 0s 3us/step - loss: 6.9727e-04
Epoch 141/500
4000/4000 [==============================] - 0s 4us/step - loss: 4.2923e-04
Epoch 142/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0087
Epoch 143/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0010
Epoch 144/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0074
Epoch 145/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0024
Epoch 146/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0155
Epoch 147/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0114
Epoch 148/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0056
Epoch 149/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0026
Epoch 150/500
4000/4000 [==============================] - 0s 2us/step - loss: 4.0948e-04
Epoch 151/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0024
Epoch 152/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0023
Epoch 153/500
4000/4000 [==============================] - 0s 3us/step - loss: 5.8745e-04
Epoch 154/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0056
Epoch 155/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0043
Epoch 156/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0032
Epoch 157/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0068
Epoch 158/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0050
Epoch 159/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0038
Epoch 160/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0018
Epoch 161/500
4000/4000 [==============================] - 0s 2us/step - loss: 9.3146e-04
Epoch 162/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0021
Epoch 163/500
4000/4000 [==============================] - 0s 4us/step - loss: 9.7937e-04
Epoch 164/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0049
Epoch 165/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0082
Epoch 166/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0029
Epoch 167/500
4000/4000 [==============================] - 0s 4us/step - loss: 6.5192e-04
Epoch 168/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0026
Epoch 169/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0037
Epoch 170/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0015
Epoch 171/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0010
Epoch 172/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0042
Epoch 173/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0055
Epoch 174/500
4000/4000 [==============================] - 0s 2us/step - loss: 9.1665e-04
Epoch 175/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0026
Epoch 176/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0066
Epoch 177/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0050
Epoch 178/500
4000/4000 [==============================] - 0s 4us/step - loss: 8.0615e-04
Epoch 179/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0062
Epoch 180/500
4000/4000 [==============================] - 0s 3us/step - loss: 4.5693e-04
Epoch 181/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0010
Epoch 182/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0023
Epoch 183/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0027
Epoch 184/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0041
Epoch 185/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0020
Epoch 186/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0052
Epoch 187/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0063
Epoch 188/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0017
Epoch 189/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0031
Epoch 190/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0016
Epoch 191/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0026
Epoch 192/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0082
Epoch 193/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0014
Epoch 194/500
4000/4000 [==============================] - 0s 4us/step - loss: 2.4609e-04
Epoch 195/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0098
Epoch 196/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0029
Epoch 197/500
4000/4000 [==============================] - ETA: 0s - loss: 2.3375e-0 - 0s 2us/step - loss: 1.7496e-04
Epoch 198/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0037
Epoch 199/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0041
Epoch 200/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0034
Epoch 201/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0021
Epoch 202/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0032
Epoch 203/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0023
Epoch 204/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0035
Epoch 205/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0080
Epoch 206/500
4000/4000 [==============================] - 0s 2us/step - loss: 9.3121e-04
Epoch 207/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0019
Epoch 208/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0054
Epoch 209/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0027
Epoch 210/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0013
Epoch 211/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0055
Epoch 212/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0024
Epoch 213/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0025
Epoch 214/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0032
Epoch 215/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0043
Epoch 216/500
4000/4000 [==============================] - 0s 2us/step - loss: 7.4135e-04
Epoch 217/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0017
Epoch 218/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0095
Epoch 219/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0049
Epoch 220/500
4000/4000 [==============================] - 0s 2us/step - loss: 5.6715e-04
Epoch 221/500
4000/4000 [==============================] - 0s 3us/step - loss: 5.7488e-04
Epoch 222/500
4000/4000 [==============================] - 0s 4us/step - loss: 7.7589e-04
Epoch 223/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0026
Epoch 224/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0044
Epoch 225/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0039
Epoch 226/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0056
Epoch 227/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0078
Epoch 228/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0043
Epoch 229/500
4000/4000 [==============================] - 0s 3us/step - loss: 9.5816e-04
Epoch 230/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0033
Epoch 231/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0149
Epoch 232/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0031
Epoch 233/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0087
Epoch 234/500
4000/4000 [==============================] - 0s 3us/step - loss: 8.8143e-04
Epoch 235/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0116
Epoch 236/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0070
Epoch 237/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0042
Epoch 238/500
4000/4000 [==============================] - 0s 3us/step - loss: 8.0859e-04
Epoch 239/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0060
Epoch 240/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0074
Epoch 241/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0085
Epoch 242/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0164
Epoch 243/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0014
Epoch 244/500
4000/4000 [==============================] - 0s 2us/step - loss: 7.8346e-04
Epoch 245/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0012
Epoch 246/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0015
Epoch 247/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0011
Epoch 248/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0010
Epoch 249/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0018
Epoch 250/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0029
Epoch 251/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0029
Epoch 252/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0113
Epoch 253/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0014
Epoch 254/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0045
Epoch 255/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0018
Epoch 256/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0052
Epoch 257/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0027
Epoch 258/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0071
Epoch 259/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0029
Epoch 260/500
4000/4000 [==============================] - 0s 3us/step - loss: 9.5936e-05
Epoch 261/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0027
Epoch 262/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0033
Epoch 263/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0041
Epoch 264/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0013
Epoch 265/500
4000/4000 [==============================] - 0s 2us/step - loss: 7.6006e-04
Epoch 266/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0040
Epoch 267/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0029
Epoch 268/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0022
Epoch 269/500
4000/4000 [==============================] - 0s 3us/step - loss: 7.3184e-04
Epoch 270/500
4000/4000 [==============================] - 0s 3us/step - loss: 4.9335e-04
Epoch 271/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0044
Epoch 272/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0058
Epoch 273/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0053
Epoch 274/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0103
Epoch 275/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0038
Epoch 276/500
4000/4000 [==============================] - 0s 2us/step - loss: 2.7207e-04
Epoch 277/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0013
Epoch 278/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0025
Epoch 279/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0036
Epoch 280/500
4000/4000 [==============================] - 0s 2us/step - loss: 4.2840e-04
Epoch 281/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0045
Epoch 282/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0018
Epoch 283/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0097
Epoch 284/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0031
Epoch 285/500
4000/4000 [==============================] - 0s 2us/step - loss: 6.0142e-04
Epoch 286/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0046
Epoch 287/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0012
Epoch 288/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0053
Epoch 289/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0014
Epoch 290/500
4000/4000 [==============================] - 0s 3us/step - loss: 4.3664e-04
Epoch 291/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0096
Epoch 292/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0014
Epoch 293/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0028
Epoch 294/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0055
Epoch 295/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0066
Epoch 296/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0014
Epoch 297/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0012
Epoch 298/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0014
Epoch 299/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0058
Epoch 300/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0010
Epoch 301/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0031
Epoch 302/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0014
Epoch 303/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0037
Epoch 304/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0101
Epoch 305/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0026
Epoch 306/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0129
Epoch 307/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0041
Epoch 308/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0043
Epoch 309/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0078
Epoch 310/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0015
Epoch 311/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0021
Epoch 312/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0065
Epoch 313/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0085
Epoch 314/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0026
Epoch 315/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0055
Epoch 316/500
4000/4000 [==============================] - 0s 3us/step - loss: 6.8507e-04
Epoch 317/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0019
Epoch 318/500
4000/4000 [==============================] - 0s 3us/step - loss: 8.1847e-04
Epoch 319/500
4000/4000 [==============================] - 0s 2us/step - loss: 5.9506e-04
Epoch 320/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0028
Epoch 321/500
4000/4000 [==============================] - 0s 3us/step - loss: 3.0153e-04
Epoch 322/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0074
Epoch 323/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0097
Epoch 324/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0032
Epoch 325/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0055
Epoch 326/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0065
Epoch 327/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0033
Epoch 328/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0048
Epoch 329/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0045
Epoch 330/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0027
Epoch 331/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0015
Epoch 332/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0033
Epoch 333/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0037
Epoch 334/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0069
Epoch 335/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0021
Epoch 336/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0018
Epoch 337/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0047
Epoch 338/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0024
Epoch 339/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0035
Epoch 340/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0037
Epoch 341/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0018
Epoch 342/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0019
Epoch 343/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0078
Epoch 344/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0075
Epoch 345/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0017
Epoch 346/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0033
Epoch 347/500
4000/4000 [==============================] - 0s 2us/step - loss: 5.7083e-04
Epoch 348/500
4000/4000 [==============================] - 0s 2us/step - loss: 6.8416e-04
Epoch 349/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0035
Epoch 350/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0012
Epoch 351/500
4000/4000 [==============================] - 0s 3us/step - loss: 9.3295e-04
Epoch 352/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0036
Epoch 353/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0040
Epoch 354/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0018
Epoch 355/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0032
Epoch 356/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0011
Epoch 357/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0037
Epoch 358/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0042
Epoch 359/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0014
Epoch 360/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0019
Epoch 361/500
4000/4000 [==============================] - 0s 4us/step - loss: 7.3767e-04
Epoch 362/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0048
Epoch 363/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0086
Epoch 364/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0023
Epoch 365/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0028
Epoch 366/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0021
Epoch 367/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0020
Epoch 368/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0017
Epoch 369/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0067
Epoch 370/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0077
Epoch 371/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0017
Epoch 372/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0070
Epoch 373/500
4000/4000 [==============================] - 0s 2us/step - loss: 9.3301e-04
Epoch 374/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0058
Epoch 375/500
4000/4000 [==============================] - 0s 2us/step - loss: 2.7479e-04
Epoch 376/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0018
Epoch 377/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0010
Epoch 378/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0082
Epoch 379/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0033
Epoch 380/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0168
Epoch 381/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0049
Epoch 382/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0065
Epoch 383/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0065
Epoch 384/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0010
Epoch 385/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0068
Epoch 386/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0028
Epoch 387/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0055
Epoch 388/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0058
Epoch 389/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0022
Epoch 390/500
4000/4000 [==============================] - 0s 2us/step - loss: 1.5737e-04
Epoch 391/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0022
Epoch 392/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0013
Epoch 393/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0043
Epoch 394/500
4000/4000 [==============================] - 0s 4us/step - loss: 2.0744e-04
Epoch 395/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0070
Epoch 396/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0027
Epoch 397/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0051
Epoch 398/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0089
Epoch 399/500
4000/4000 [==============================] - 0s 2us/step - loss: 7.4866e-04
Epoch 400/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0033
Epoch 401/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0017
Epoch 402/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0023
Epoch 403/500
4000/4000 [==============================] - 0s 3us/step - loss: 4.6038e-04
Epoch 404/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0078
Epoch 405/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0022
Epoch 406/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0027
Epoch 407/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0031
Epoch 408/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0031
Epoch 409/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0018
Epoch 410/500
4000/4000 [==============================] - 0s 2us/step - loss: 6.7186e-04
Epoch 411/500
4000/4000 [==============================] - 0s 2us/step - loss: 6.9071e-04
Epoch 412/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0049
Epoch 413/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0073
Epoch 414/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0013
Epoch 415/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0041
Epoch 416/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0013
Epoch 417/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0074
Epoch 418/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0043
Epoch 419/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0036
Epoch 420/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0029
Epoch 421/500
4000/4000 [==============================] - 0s 3us/step - loss: 4.3924e-04
Epoch 422/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0032
Epoch 423/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0100
Epoch 424/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0122
Epoch 425/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0038
Epoch 426/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0013
Epoch 427/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0016
Epoch 428/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0036
Epoch 429/500
4000/4000 [==============================] - 0s 4us/step - loss: 6.3367e-04
Epoch 430/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0022
Epoch 431/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0064
Epoch 432/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0015
Epoch 433/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0017
Epoch 434/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0044
Epoch 435/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0018
Epoch 436/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0052
Epoch 437/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0050
Epoch 438/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0076
Epoch 439/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0063
Epoch 440/500
4000/4000 [==============================] - 0s 4us/step - loss: 8.9774e-04
Epoch 441/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0012
Epoch 442/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0026
Epoch 443/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0063
Epoch 444/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0027
Epoch 445/500
4000/4000 [==============================] - 0s 5us/step - loss: 7.9725e-04
Epoch 446/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0026
Epoch 447/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0058
Epoch 448/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0054
Epoch 449/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0081
Epoch 450/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0105
Epoch 451/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0103
Epoch 452/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0020
Epoch 453/500
4000/4000 [==============================] - 0s 6us/step - loss: 0.0017
Epoch 454/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0032
Epoch 455/500
4000/4000 [==============================] - 0s 6us/step - loss: 0.0033
Epoch 456/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0037
Epoch 457/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0018
Epoch 458/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0046
Epoch 459/500
4000/4000 [==============================] - 0s 2us/step - loss: 9.3268e-04
Epoch 460/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0022
Epoch 461/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0028
Epoch 462/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0048
Epoch 463/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0010
Epoch 464/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0048
Epoch 465/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0036
Epoch 466/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0071
Epoch 467/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0097
Epoch 468/500
4000/4000 [==============================] - 0s 2us/step - loss: 8.8276e-04
Epoch 469/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0027
Epoch 470/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0087
Epoch 471/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0059
Epoch 472/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0101
Epoch 473/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0095
Epoch 474/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0017
Epoch 475/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0029
Epoch 476/500
4000/4000 [==============================] - 0s 2us/step - loss: 8.7882e-04
Epoch 477/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0024
Epoch 478/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0105
Epoch 479/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0021
Epoch 480/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0133
Epoch 481/500
4000/4000 [==============================] - 0s 3us/step - loss: 4.8938e-04
Epoch 482/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0110
Epoch 483/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0029
Epoch 484/500
4000/4000 [==============================] - 0s 5us/step - loss: 0.0014
Epoch 485/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0039
Epoch 486/500
4000/4000 [==============================] - 0s 1us/step - loss: 0.0035
Epoch 487/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0014
Epoch 488/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0081
Epoch 489/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0028
Epoch 490/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0013
Epoch 491/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0167
Epoch 492/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0061
Epoch 493/500
4000/4000 [==============================] - 0s 2us/step - loss: 8.1686e-04
Epoch 494/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0061
Epoch 495/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0077
Epoch 496/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0015
Epoch 497/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0015
Epoch 498/500
4000/4000 [==============================] - 0s 2us/step - loss: 0.0023
Epoch 499/500
4000/4000 [==============================] - 0s 4us/step - loss: 0.0116
Epoch 500/500
4000/4000 [==============================] - 0s 3us/step - loss: 0.0029
Out[4]:
<keras.callbacks.History at 0x7f534ca147f0>
In [5]:
[[  3.1393  -0.0989]
 [  4.1386   0.001 ]
 [  3.1393  -9.9937]
 [103.0637   0.001 ]]
wagi:
 gamma = [ 0.7081 -2.9986],
 beta = [3.1393 0.001 ],
 mu = [-0. -0.],
 sigma = [  0.5011 900.0883]
In [ ]: