Deployment Containers

Base Containers

When you launch a Deployment, it runs inside a Docker container (often referred to as a runtime. Any Docker image hosted in a public or private container registry can be used as the Deployment's runtime. Additionally, Gradient includes several popular runtimes out of the box:

Name

Description

Container Tag

URL

TensorFlow

TensorFlow Serving

tensorflow/serving:latest-gpu

ONNX

Based on the official ONNX community project

paperspace/onnx

TensorRT

NVIDIA's optimized runtime

paperspace/tensorrt

Other Containers

Name

Description

Container Tag

URL

Flask

A basic Python web server framework

paperspace/flask

Also see Custom Deployment Containers

Custom Deployment Containers

Last updated