Inference API

Use the Inference API when you want programmatic access to RemoteGPU models without operating Kubernetes directly.

This product path is designed for developers, application teams, and integrators who want HTTP-based model access with API keys.

Choose this path when

Use the Inference API when you want:

• HTTP access from your application, backend, script, or automation
• direct control over prompts, model selection, and request parameters
• model execution without operating namespace-scoped Kubernetes workloads

How this product path works

The Inference API uses HTTP requests authenticated with an API key. RemoteGPU serves the model and executes the request, so your application does not need to operate Kubernetes workloads directly.

Use the console for visibility and examples, then call the API from your application, backend, script, or automation.

Available API guides

• Text: send OpenAI-compatible chat-completion requests and receive synchronous chat.completion responses
• Image: send image-generation requests and poll job status

The text API uses OpenAI-compatible request paths and Bearer authentication. It returns a synchronous chat.completion response.

The image API uses the size request field with fixed size presets. It does not accept arbitrary top-level width and height fields.

How this differs from the other product paths

The Inference API is the direct HTTP product path. Your team manages requests, prompts, model selection, and keys.

Use Application when you want a guided hosted workflow from the console.

Use Kubernetes when your team wants to manage native workloads, networking, and storage resources in a namespace.

Read next

• Read API keys if you need to decide which API key to create.
• Read Text to submit a chat-completion request.
• Read Image to send your first image-generation request.