Deep Learning - Model Deployment

Model Deployment

Posted by Rico's Nerd Cluster on May 21, 2022

Deployment On Edge Devices

  • Inferencing Using C++

  • Embedded systems
    • Need streaming. ZeroMQ might be better than Websocket. Need an article
  • A serializable model means a model that can be serialized, saved, reloaded, and reconstructed.
    • A non-serializable model usually contains non-pickleble objects, like open file handles, sockets, or lambda functions

References

https://blog.csdn.net/kieven2008/article/details/106185121