tensorflow - 将 keras 模型导出为 tf savedModel 格式:如何修复 serving_input_fn
问题描述
我想利用 google 的 AI 平台来部署我的 keras 模型,这要求模型采用 tensorflow SavedModel 格式。我将 keras 模型保存到 tensorflow 估计器模型,然后导出这个估计器模型。我在定义我的serving_input_receiver_fn
.
这是我的模型的摘要:
Model: "model_49"
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
input_49 (InputLayer) [(None, 400, 254)] 0
_________________________________________________________________
gru_121 (GRU) (None, 400, 64) 61248
_________________________________________________________________
gru_122 (GRU) (None, 64) 24768
_________________________________________________________________
dropout_73 (Dropout) (None, 64) 0
_________________________________________________________________
1M (Dense) (None, 1) 65
=================================================================
Total params: 86,081
Trainable params: 86,081
Non-trainable params: 0
_________________________________________________________________
这是我遇到的错误:
KeyError: "The dictionary passed into features does not have the expected
inputs keys defined in the keras model.\n\tExpected keys:
{'input_49'}\n\tfeatures keys: {'col1','col2', ..., 'col254'}
下面是我的代码。
def serving_input_receiver_fn():
feature_placeholders = {
column.name: tf.placeholder(tf.float64, [None]) for column in INPUT_COLUMNS
}
# feature_placeholders = {
# 'input_49': tf.placeholder(tf.float64, [None])
# }
features = {
key: tf.expand_dims(tensor, -1)
for key, tensor in feature_placeholders.items()
}
return tf.estimator.export.ServingInputReceiver(features, feature_placeholders)
def run():
h5_model_file = '../models/model2.h5'
json_model_file = '../models/model2.json'
model = get_keras_model(h5_model_file, json_model_file)
print(model.summary())
estimator_model = tf.keras.estimator.model_to_estimator(keras_model=model, model_dir='estimator_model')
export_path = estimator_model.export_saved_model('export',
serving_input_receiver_fn=serving_input_receiver_fn)
似乎我的模型需要一个单一的特征键:(input_49
我的神经网络的第一层),但是,例如,从我看到的代码示例中,将serving_receiver_input_fn
所有特征的字典输入到我的模型中。
我该如何解决这个问题?
我正在使用 tensorflow==2.0.0-beta1。
解决方案
我已经设法保存了一个 Keras 模型并使用 TF Serving 使用该tf.saved_model.Builder()
对象托管它。我不确定这是否可以很容易地推广到您的应用程序,但下面是对我有用的方法,尽可能通用。
# Set the path where the model will be saved.
export_base_path = os.path.abspath('models/versions/')
model_version = '1'
export_path = os.path.join(tf.compat.as_bytes(export_base_path),
tf.compat.as_bytes(model_version))
# Make the model builder.
builder = tf.saved_model.builder.SavedModelBuilder(export_path)
# Define the TensorInfo protocol buffer objects that encapsulate our
# input/output tensors.
# Note you can have a list of model.input layers, or just a single model.input
# without any indexing. I'm showing a list of inputs and a single output layer.
# Input tensor info.
tensor_info_input0 = tf.saved_model.utils.build_tensor_info(model.input[0])
tensor_info_input1 = tf.saved_model.utils.build_tensor_info(model.input[1])
# Output tensor info.
tensor_info_output = tf.saved_model.utils.build_tensor_info(model.output)
# Define the call signatures used by the TF Predict API. Note the name
# strings here should match what the layers are called in your model definition.
# Might have to play with that because I forget if it's the name parameter, or
# the actual object handle in your code.
prediction_signature = (
tf.saved_model.signature_def_utils.build_signature_def(
inputs={'input0': tensor_info_input0, 'input1': tensor_info_input1},
outputs={'prediction': tensor_info_output},
method_name=tf.saved_model.signature_constants.PREDICT_METHOD_NAME))
# Now we build the SavedModel protocol buffer object and then save it.
builder.add_meta_graph_and_variables(sess,
[tf.saved_model.tag_constants.SERVING],
signature_def_map={'predict': prediction_signature})
builder.save(as_text=True)
我会尝试找到让我来到这里的参考资料,但当时我没有记下它们。当我找到它们时,我会更新链接。
推荐阅读
- python - 将 np 数组转换为列并将其附加到另一个数据帧
- asp.net - ASP.NET v4 输入字符串格式不正确异常
- php - codeigniter 中的更新记录问题
- azure-api-management - 使用 Azure APIM 策略处理表单数据
- javascript - 如何在不使用插件的情况下将 jQuery 1.5.1 升级到 3.0
- python - 返回具有条件的数据框 Python 中的模式值
- php - 如何将css样式添加到php属性
- express - 为什么在 express.js 中 get() 成功处理请求后 use() 方法仍然执行?
- python - TypeError:字符串索引必须是整数。不知道我做错了什么
- javascript - 将大型视频文件分块并附加到 BLOB 以进行连续播放