MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
-
Updated
Mar 6, 2023 - Python
MLModelCI is a complete MLOps platform for managing, converting, profiling, and deploying MLaaS (Machine Learning-as-a-Service), bridging the gap between current ML training and serving systems.
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
🖧 Simple gRPC client in Go to communicate with TensorRT Inference Server
Add a description, image, and links to the tensorrt-inference-server topic page so that developers can more easily learn about it.
To associate your repository with the tensorrt-inference-server topic, visit your repo's landing page and select "manage topics."