Inference API

​

Before you start

• Your Gravity AI platform account is approved.
• Gravity has enabled Inference for your account (ask your Gravity contact if the Inference page is missing in the dashboard).
• You will create a dedicated inference key (gr_inf_...). Do not reuse your publisher ads API key.

​

1. Create an inference key

1. Open app.trygravity.com/platform/inference.
2. Create a key. Copy it once. Gravity stores only a hash.
3. Save it as GRAVITY_INFERENCE_KEY on your server.

​

2. Models

​

3. Call chat completions

1. session_id in the JSON body (preferred)
2. X-Gravity-Session-Id header
3. OpenAI user field

• email_hash: SHA-256 hex of the lowercased, trimmed email (raw emails are rejected). Ties the request to the same person as ads hashed_email.
• OpenAI user (1 to 128 characters): also recorded as the end user for rate limits and usage.

from openai import OpenAI

client = OpenAI(
    base_url="https://inference.trygravity.ai/v1",
    api_key="YOUR_DEDICATED_GRAVITY_INFERENCE_KEY",
    max_retries=0,
)

result = client.chat.completions.create(
    model="@cf/deepseek-ai/deepseek-v4.1-flash-1017",
    messages=[{"role": "user", "content": "Hello"}],
    max_tokens=1024,
    stream=False,
    extra_body={"session_id": "YOUR_SESSION_ID"},
)
print(result.choices[0].message.content)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://inference.trygravity.ai/v1",
  apiKey: process.env.GRAVITY_INFERENCE_KEY!,
  maxRetries: 0,
});

const result = await client.chat.completions.create({
  model: "@cf/deepseek-ai/deepseek-v4.1-flash-1017",
  messages: [{ role: "user", content: "Hello" }],
  max_tokens: 1024,
  // @ts-expect-error Gravity extension
  session_id: "YOUR_SESSION_ID",
});

curl https://inference.trygravity.ai/v1/chat/completions \
  -H "Authorization: Bearer $GRAVITY_INFERENCE_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "@cf/deepseek-ai/deepseek-v4.1-flash-1017",
    "messages": [{"role": "user", "content": "Hello"}],
    "max_tokens": 1024,
    "session_id": "YOUR_SESSION_ID"
  }'

​

Supported features

• Streaming (stream: true, SSE ending in data: [DONE]) and non-streaming
• Tool calling (tools, tool_choice, parallel_tool_calls, assistant tool_calls, tool messages)
• String or content-part array message content
• temperature, top_p, stop, seed, presence_penalty, frequency_penalty, response_format, reasoning_effort
• developer messages are sent to the provider as system
• Unknown top-level parameters are ignored (not rejected), so standard harness adapters work
• Usage in the stream only when the client sets stream_options.include_usage

​

Not supported

• n (multiple completions)
• Audio
• Browser CORS (use server-side clients)

​

4. Rate limits (pilot)

​

Live today

​

Documented for the pilot (enforcement landing soon)

​

5. Errors to know

​

6. Ads and sessions

​

7. Dashboard

• Create and revoke inference keys
• See request volume, errors, tokens, and latency
• Try models in the playground (non-streaming)

​

Pilot checklist

1. Confirm Inference appears in your dashboard.
2. Create a key and hit GET /v1/models.
3. Send a non-streaming chat with session_id.
4. Wire streaming if your product streams.
5. Pass a stable per-user id in user / end_user so per-user limits apply correctly.
6. Launch your free-tier campaign with the same session ids you use for ads.
7. Sync with Gravity after ~5 days of token data to tune limits and models.