Relative Content

Tag Archive for tensorflowtensorflow-serving

Tensorflow Serving: Adding warm start data at runtime

I’m trying to dynamically add warm-start data for our models via the SavedModel Warmup method (https://www.tensorflow.org/tfx/serving/saved_model_warmup). In our case, we need to actually have the model running in order to do some request input filtering. Is it possible to use the reload config request to reload the model and have it run with warm start? Currently I’m finding that after the reload request, it does not do a full reload, it just refreshes:

Multiple Model Configuration in tensorflow serving

i have created a file model.config for configuration detail and it is inside model_config and model_config is inside untitlled folder from where iam executing my script and getting the path not found error while passing configuration file