A Deployed Model's API Endpoint
Deployment states
When the deployment reaches the running state, it is available to make predictions. See the full list of states here.
Endpoint URL
Once deployed, a secure URL will become available to make predictions. This URL will be persisted until the deployment is deleted.
Basic authentication
If basic authentication is enabled, the username and password must be passed-in with each request in order to reach the endpoint.
Protocol
Gradient supports both REST and gRPC Deployment endpoints. See this article for more information on the differences.
Load balancing
Incoming requests will be automatically load-balanced in a round-robin fashion if multiple instances are running.
Last updated