tensorflow-serving

Tensorflow Serving on docker using tflite file


I was trying to deploy ML model with the Tensorflow Serving. Even though I added sharing file path on the docker. This error keep comes out somehow. And I am working with a tflite file to deploy it, and it seems like not work at all. Please help and give some recommendations or feedback.

file sharing Error


Solution

  • You can use the TF Saved Model Format (.pb).

    save your model as save model format:

    model.save('saved_model/1/', save_format="tf")
    

    This Link shows how you can change your .tflite model to a standard model. It might be helpful.

    Also in your picture: your mount directory is incorrect in tensorflow docker serving. you can use this command to run docker:

    docker run -p 8501:8501 \
      --mount type=bind,source=/path/to/my_model/,target=/models/my_model \
      -e MODEL_NAME=my_model -t tensorflow/serving