validation - Keras: Very high loss for Autoencoder
问题描述
I am trying to implement an autoencoder for prediction of multiple labels using Keras. This is a snippet:
input = Input(shape=(768,))
hidden1 = Dense(512, activation='relu')(input)
compressed = Dense(256, activation='relu', activity_regularizer=l1(10e-6))(hidden1)
hidden2 = Dense(512, activation='relu')(compressed)
output = Dense(768, activation='sigmoid')(hidden2) # sigmoid is used because output of autoencoder is a set of probabilities
model = Model(input, output)
model.compile(optimizer='adam', loss='categorical_crossentropy') # categorical_crossentropy is used because it's prediction of multiple labels
history = model.fit(x_train, x_train, epochs=100, batch_size=50, validation_split=0.2)
I ran this in Jupyter Notebook (CPU) and I am getting loss and validation loss as:
loss: 193.8085 - val_loss: 439.7132
but when I ran it in Google Colab (GPU), I am getting very high loss and validation loss:
loss: 28383285849773932.0000 - val_loss: 26927464965996544.0000
.
What could be the reason for this behavior?
解决方案
推荐阅读
- javascript - 是否可以使用变量来调用函数作为参数javascript
- php - XPath 选择器适用于 chrome 开发工具,但不适用于 php domXpath 为什么会这样
- python - 在python中将递归__setitem__转换为迭代
- c# - 在面向 x86 的 docker 中运行 .NET Core 项目会引发 System.BadImageFormatException
- python - 提交未上传到 codecov
- typescript - 无法在数据中获取变量
- vb.net - 如何在文本框中输入最大长度的字符后添加空格
- java - Android Studio 更新到 3.4 后未在工具菜单中显示 SDK Manager 和 AVDManager
- python - 如何访问 Pandas 系列中的最后一个元素?
- node.js - 使用 Docker 运行单个 NodeJS 脚本并能够使用 Ctrl-C 终止它的最简单方法是什么