GMI Cloud

One cloud for compute, inference, and agents. GMI Cloud is an NVIDIA Reference Platform Cloud Partner running production AI workloads on H100, H200, and Blackwell — from a serverless token-billed API all the way down to bare-metal clusters with root access.

If it runs on the Hub, we can serve it. Below is everything you need to send your first request.

Start in 30 seconds

Our Inference Engine is OpenAI-compatible — point the SDK you already use at our base URL.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.gmi-serving.com/v1",
    api_key="YOUR_GMI_API_KEY",   # console.gmicloud.ai → API Keys
)

response = client.chat.completions.create(
    model="deepseek-ai/DeepSeek-V4-Flash",
    messages=[{"role": "user", "content": "Hello, what can you do?"}],
)

print(response.choices[0].message.content)

curl https://api.gmi-serving.com/v1/chat/completions \
  -H "Authorization: Bearer $GMI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deepseek-ai/DeepSeek-V4-Flash",
    "messages": [{"role": "user", "content": "Hello, what can you do?"}]
  }'

Tool calling, structured outputs and streaming all work exactly as they do against OpenAI — so the same two lines swap GMI Cloud into Claude Code, Codex, Cursor, OpenCode, Kilo, Factory, Dify and Hermes with no code changes.

Quickstart · LLM API reference · Rate limits · Get an API key

Guides — start from what you're trying to do

All guides → · Full documentation → · llms.txt (point your agent at this)

What we run

Model coverage

Full model library with per-model quickstarts →

Hardware

Deployed on NVIDIA Reference Platform Cloud Architecture as an NVIDIA Preferred Partner, with RDMA-ready interconnect and multi-tenant isolation for predictable tail latency. Current pricing →

Get started

Console · Docs · Quickstart · Playground · API reference · Pricing

💬 Join the GMI Cloud Discord — talk to our engineers, get help, and hear about new models first.

gmicloud.ai · X / @gmi_cloud · LinkedIn · Talk to us about dedicated capacity