Deployment Containers
Base Containers
When you launch a Deployment, it runs inside a Docker container (often referred to as a runtime. Any Docker image hosted in a public or private container registry can be used as the Deployment's runtime. Additionally, Gradient includes several popular runtimes out of the box:
Popular Containers
Name | Description | Container Tag | URL |
TensorFlow | TensorFlow Serving |
| |
ONNX | Based on the official ONNX community project |
| |
TensorRT | NVIDIA's optimized runtime |
|
Other Containers
Name | Description | Container Tag | URL |
Flask | A basic Python web server framework |
|
Also see Custom Deployment Containers
Custom Deployment ContainersLast updated