python - TensorFlow 程序陷入无限训练循环
问题描述
我正在使用 GAN 教程中的代码在 tensorflow 中生成 MNIST 数字。
(链接在这里:https ://www.tensorflow.org/beta/tutorials/generation/dcgan )
目前,该程序陷入了无限的训练循环。我将训练数据集设置为只有一张图像,并设置 epoch = 1。我在循环中插入了打印语句。在 train() 函数中,它只打印 a 和 b,但不打印 c,这意味着它在第二个 for 循环中陷入了无限循环。
在这里,我加载、洗牌和批处理数据(训练数据集只是一张用于测试目的的图像)
(train_images, train_labels), (_, _) = tf.keras.datasets.mnist.load_data()
train_images = train_images.reshape(train_images.shape[0], 28, 28, 1).astype('float32')
train_images = (train_images - 127.5) / 127.5 # Normalize the images to [-1, 1]
train_images = train_images[0:1,:,:,:]
print(train_images.shape)
BUFFER_SIZE = 1
BATCH_SIZE = 1
# Batch and shuffle the data
train_dataset = tf.data.Dataset.from_tensor_slices(train_images).shuffle(BUFFER_SIZE).batch(BATCH_SIZE)
print(train_dataset)
这些是定义生成器和鉴别器模型、损失的函数
def make_generator_model():
...
return model
generator = make_generator_model()
noise = np.random.normal(size=(1, 100))
generated_image = generator.predict(noise)
def make_discriminator_model():
...
return model
discriminator = make_discriminator_model()
decision = discriminator.predict(generated_image)
cross_entropy = tf.keras.losses.BinaryCrossentropy(from_logits=True)
def discriminator_loss(real_output, fake_output):
...
return total_loss
def generator_loss(fake_output):
return cross_entropy(tf.ones_like(fake_output), fake_output)
generator_optimizer = tf.keras.optimizers.Adam(1e-4)
discriminator_optimizer = tf.keras.optimizers.Adam(1e-4)
这些是训练函数:
EPOCHS = 1
noise_dim = 100
seed = tf.random.normal([num_examples_to_generate, noise_dim])
def train_step(images):
noise = tf.random.normal([BATCH_SIZE, noise_dim])
with tf.GradientTape() as gen_tape, tf.GradientTape() as disc_tape:
generated_images = generator(noise, training=True)
print(images.shape)
real_output = discriminator(images, training=True)
fake_output = discriminator(generated_images, training=True)
gen_loss = generator_loss(fake_output)
disc_loss = discriminator_loss(real_output, fake_output)
gradients_of_generator = gen_tape.gradient(gen_loss, generator.trainable_variables)
gradients_of_discriminator = disc_tape.gradient(disc_loss, discriminator.trainable_variables)
generator_optimizer.apply_gradients(zip(gradients_of_generator, generator.trainable_variables))
discriminator_optimizer.apply_gradients(zip(gradients_of_discriminator, discriminator.trainable_variables))
def train(dataset, epochs):
for epoch in range(epochs):
start = time.time()
for image_batch in dataset: #stuck in an infinite loop
print('a')
train_step(image_batch)
print('b')
print('c')
# Produce images for the GIF as we go
display.clear_output(wait=True)
generate_and_save_images(generator,epoch + 1,seed)
print('d')
# Save the model every 1 epochs
if (epoch + 1) % 1 == 0:
checkpoint.save(file_prefix = checkpoint_prefix)
print ('Time for epoch {} is {} sec'.format(epoch + 1, time.time()-start))
# Generate after the final epoch
display.clear_output(wait=True)
generate_and_save_images(generator,epochs,seed)
def generate_and_save_images(model, epoch, test_input):
...
train(train_dataset, EPOCHS)
解决方案
解决了。原来我使用的是 tensorflow 1.14,但代码是用 tensorflow 2.0 编写的。在 tf 1.x 中,我需要一个迭代器来逃避无限循环。
推荐阅读
- javascript - 如何在 React 中获取嵌入式 Monaco 编辑器的行数?(包括包装)
- json - 在 Swift 中从 json 到 struct 的解码失败
- python - 数据类:super() .__ init __ () 的继承等价物是什么?
- html - ipfs 节点无法连接到我在本地主机上运行的 react 应用程序
- reactjs - 单击时更改 Material UI IconButton 图标
- laravel - Laravel 8 查询生成器 WhereIn Like
- android - 我多次生成 apk 并且他没有以前的代码更改,但是在模拟器 android、iOS 和 iOS 财务设备中,更改显示了它
- reactjs - 如何从数据库 firebase 获取和渲染点
- python - 我怎样才能找到幂零矩阵?
- python - 尝试调用类中的函数时出现名称错误