Deployment On Edge Devices
-
Inferencing Using C++
- Embedded systems
- Need streaming. ZeroMQ might be better than Websocket. Need an article
- A serializable model means a model that can be serialized, saved, reloaded, and reconstructed.
- A non-serializable model usually contains non-pickleble objects, like open file handles, sockets, or lambda functions