python - 在运行时使用 keras 从自动编码器模型中保存隐藏层的特征
问题描述
我正在训练一个自动编码器模型,并希望在运行时从编码器部分保存每个图像的特征,并稍后将其用于特征匹配。
我的模型结构是-
train_data_dir = '/train'
test_data_dir = '/test'
nb_train_samples = 100
nb_validation_samples = 25
nb_epoch = 2
batch_size = 5
input_img = Input(shape=( img_width, img_height,3))
x = Conv2D(128, (3, 3), activation='relu', padding='same')(input_img)
x = MaxPooling2D((2, 2), padding='same')(x)
x = Conv2D(64, (3, 3), activation='relu', padding='same')(x)
x = MaxPooling2D((2, 2), padding='same')(x)
x = Conv2D(32, (3, 3), activation='relu', padding='same')(x)
x = MaxPooling2D((2, 2), padding='same')(x)
x = Conv2D(16, (3, 3), activation='relu', padding='same')(x)
x = MaxPooling2D((2, 2), padding='same')(x)
x = Conv2D(8, (3, 3), activation='relu', padding='same')(x)
encoded = MaxPooling2D((2, 2), padding='same')(x)
x = Conv2D(8, (3, 3), activation='relu', padding='same')(encoded)
x = UpSampling2D((2, 2))(x)
x = Conv2D(16, (3, 3), activation='relu', padding='same')(x)
x = UpSampling2D((2, 2))(x)
x = Conv2D(32, (3, 3), activation='relu',padding='same')(x)
x = UpSampling2D((2, 2))(x)
x = Conv2D(64, (3, 3), activation='relu', padding='same')(x)
x = UpSampling2D((2, 2))(x)
x = Conv2D(128, (3, 3), activation='relu', padding='same')(x)
x = UpSampling2D((2, 2))(x)
decoded = Conv2D(3, (3, 3), activation='sigmoid', padding='same')(x)
autoencoder = Model(input_img, decoded)
autoencoder.compile(optimizer='adadelta', loss='binary_crossentropy')
def fixed_generator(generator):
for batch in generator:
yield (batch, batch)
train_datagen = ImageDataGenerator(
rescale=1./255,
shear_range=0.2,
zoom_range=0.2,
horizontal_flip=True)
# this is the augmentation configuration we will use for testing:
# only rescaling
test_datagen = ImageDataGenerator(rescale=1./255)
train_generator = train_datagen.flow_from_directory(
train_data_dir,
target_size=(img_width, img_height),
batch_size=batch_size,
class_mode=None)
#print(type(train_generator))
test_generator = test_datagen.flow_from_directory(
test_data_dir,
target_size=(img_width, img_height),
batch_size=batch_size,
class_mode=None)
autoencoder.fit_generator(
fixed_generator(train_generator),
epochs=nb_epoch,
samples_per_epoch=nb_train_samples,
validation_data=fixed_generator(test_generator),
validation_steps=nb_validation_samples
)
如何在模型拟合期间保存编码器部分的特征。有什么办法吗,求推荐
解决方案
要从自动编码器模型中保存特征,首先需要加载模型并从模型中提取最后一个编码器层。
Here is the code to extract the layers of an encoder and save the features for an image:
autoencoder= load_model('model_weights.h5')
encoder = Model(autoencoder.input, autoencoder.layers[-1].output)
# Read your input image for which you need to extract features
img = cv2.imread(img)
newimg = cv2.resize(img,(512,512))
encoded_imgs = encoder.predict(newimg[None])[0]
# Save your features as an numpy array
np.save('features.npy', encoded_imgs)
After saving your feature for an input image you need to find the euclidean distance for feature matching.
file = 'sample.npy'
file = np.load(file)
file1 = "features.npy"
file1 = np.load(file1)
distance = np.linalg.norm(file-file1)
print(distance)
This code will extract the features from an image and calculate the distance between two numpy arrays.
推荐阅读
- django - 使用 django rest 框架登录
- javascript - 如何使用 ajax 调用仅绑定新的输入数据而不是表单的所有数据以将数据发送到控制器?
- google-pagespeed - Lighthouse 返回错误:FAILED_DOCUMENT_REQUEST。Chrome 审核通过
- python - 如何将 df.loc[] 应用于多行并应用转换?
- django - 使用 Django 进行模型迁移(无法迁移)
- reactjs - 使用没有 npm 或 yarn 的 JS 包
- ruby-on-rails - Rails - file.readlines 与 file.gets
- javascript - 我对返回 URL 而不是数据的代码有疑问
- r - 使用 R 而不使用 Selenium 进行网页抓取
- c# - WPF:同步融合图表的更新数据