Inference for AI agents

Serving, the way agents need it.

Most inference is served for chat: one question, one answer, goodbye. Layer X1's engine was built from the ground up for agents — runs that last hours, hammer tools, and cannot afford a dropped call. You point an agent at the endpoint; the engine guarantees the rest.

The guarantees[01/04]

Five guarantees, held on every request.

You point an agent at an endpoint. We do the rest. You never see the machinery — you see what it guarantees.

  1. 01

    Always on

    Degradation never reaches your run — serving recovers before your agent notices, with no retries to write and no fallback lists to maintain on your side. Zero downtime is the design target, not a status-page apology.

  2. 02

    Fast for agents, from the ground up

    Chat inference optimizes one answer. Agent inference is different: hours-long trajectories, tool calls every few seconds, context that keeps growing. Our stack was built for that shape of traffic from day one — sustained throughput across the whole run, not a fast first token and a slow everything else.

  3. 03

    Usage that reads huge

    Plans carry a monthly pool of included usage measured in dollars at public list rates — $60 of model usage on a $5 plan, $300 on Pro. Nearly every model in the catalog draws from that one pool on every paid plan: no per-model surcharges, nothing to tune. A couple of frontier models are tier-reserved (Opus 5 on Pro/Max, Fable 5 on Max) and marked on the catalog with a plan chip.

  4. 04

    Tool calls that hold

    Agent loops live and die on tool calling. The engine enforces strict, schema-faithful tool calls under load, on every model in the catalog, in both agent dialects — so a malformed call never silently derails a run.

  5. 05

    Any agent, no ceremony

    Anthropic-compatible and OpenAI-compatible endpoints, streaming everywhere, one key. If it runs an agent loop, it runs here — the engine does not care which framework is driving.

Point an agent here →
REQUEST PATHCUTAWAY
The catalog[03/04]

Every model, behind one endpoint.

You hold one key and one endpoint — never another vendor account, quota, or bill. Open-weight flagships sit next to premium frontier models behind the same door, and the catalog keeps growing. One key reaches all of it.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.layerx1.com/v1",
    api_key="lx1_your_key",
)

response = client.chat.completions.create(
    model="lx1-gpt-oss-120b",
    messages=[{"role": "user", "content": "Say hello."}],
)
Both dialects · one lx1_ key · every model in the catalogFull API reference →
Live in the catalog todaygrowing
Claude Opus 5frontierClaude Fable 5frontierClaude Opus 4.7frontierGPT-5.5frontierGPT-5.4frontierGemini 3 ProfrontierKimi K3frontierDeepSeek V4 ProcodingQwen3.7 MaxfrontierInklingfrontierGPT-OSS 120Bgeneral purposeQwen 3.8 27Bgeneral purposeSonnet 4.6premiumClaude Sonnet 5premiumClaude Haiku 4.5premiumGrok 4.3premiumGLM 5.2codingGLM 5codingQwen3 Coder 480BcodingKimi K2.7 CodecodingQwen3-MaxcodingQwen3 235BreasoningDeepSeek V3.2reasoningKimi K2 ThinkingreasoningMiniMax M2.5reasoningERNIE X1reasoningHunyuan T1reasoningStep 3reasoningQwen3.5 397BreasoningNemotron 3 UltrareasoningNemotron Super 3 120Bgeneral purposeNemotron 3 120Bgeneral purposeQwen3 Next 80Bgeneral purposeGemma 4 31Bgeneral purposeMistral Large 3 675Bgeneral purpose
ERNIE 5.1general purposeHunyuan TurboSgeneral purposeGemini 3 Flashgeneral purposeMiniMax M3general purposeKimi K2.6general purposeGLM 4.7general purposeQwen3.7 Plusgeneral purposeQwen3 VL 235Bgeneral purposeHunyuan Hy3general purposeLlama 3.3 70Bgeneral purposeQwen3 Coder 30Beveryday codingQwen3 Coder Nexteveryday codingKimi K2.5everyday codingDevstral 2 123Beveryday codingMiniMax M2.7everyday codingKAT Coder Proeveryday codingGemma 4 26Blong contextLongCat 2.0codingDeepSeek V4 Flashgeneral purposeQwen3.5 Flashlong contextMiMo V2.5long contextQwen TurbofastQwen 3.8 MaxreasoningGPT-OSS 20BfastGLM 4.7 FlashfastNemotron Nano 3 30BfastStep 3.7 FlashfastBGE-M3embeddingsBGE Base EN v1.5embeddingsBGE Small EN v1.5embeddingsBGE Large EN v1.5embeddingsEmbeddingGemma 300MembeddingsQwen3 Embedding 0.6BembeddingsPLaMo Embedding 1Bembeddings
Browse every model →
Works under your agent[04/04]

Point any agent here in one command.

Run npx layerx1 and pick your tools — the installer writes each config where the tool expects it, key and model included; GUI-configured tools get their exact paste-in values. No SDK, no code changes. The session below is the setup.

npx layerx1live session · replay
$ npx layerx1 ██╗ █████╗ ██╗ ██╗███████╗██████╗ ██╗ ██╗ ██╗ ██║ ██╔══██╗╚██╗ ██╔╝██╔════╝██╔══██╗ ╚██╗██╔╝███║ ██║ ███████║ ╚████╔╝ █████╗ ██████╔╝ ╚███╔╝ ╚██║ ██║ ██╔══██║ ╚██╔╝ ██╔══╝ ██╔══██╗ ██╔██╗ ██║ ███████╗██║ ██║ ██║ ███████╗██║ ██║ ██╔╝ ██╗ ██║ ╚══════╝╚═╝ ╚═╝ ╚═╝ ╚══════╝╚═╝ ╚═╝ ╚═╝ ╚═╝ ╚═╝ ▚▚▚ Layer X1 · one endpoint · one key · every model ──────────────────────────────────────────────────────── step 1/5 Pick your tools space toggles · already-installed tools are pre-selected Which tools should point at Layer X1? 2 already installed · space toggle · a all · enter confirm · esc cancel Terminal agents ❯ ◉ Claude Code installed · writes config ◉ OpenAI Codex CLI installed · writes config ◯ Aider not installed · writes config ◯ Hermes Agent not installed · writes config Editors & extensions ◯ Continue (VS Code / JetBrains) not installed · writes config 2 selected step 2/5 Install what's missing installed tools are skipped ✓ Claude Code already installed — skipped ✓ OpenAI Codex CLI already installed — skipped ✓ everything you picked is already installed. step 3/5 Choose your models loaded live from the gateway — new models appear here automatically ✓ 34 models live from https://api.layerx1.com Primary model the default your agent uses · recommended: lx1-deepseek-v4-flash Coding flagship ○ lx1-qwen3-coder-480b 131k ctx · $0.45/$1.8 per Mtok ○ lx1-glm-5.2 131k ctx · $1.4/$4.4 per Mtok · reasoning Workhorse ❯ ● lx1-deepseek-v4-flash 1M ctx · $0.44/$1.32 per Mtok · reasoning step 4/5 Your API key pasted input is masked and only written to the tool configs you picked Paste your Layer X1 API key: lx1_•••••••••••• step 5/5 Review and apply gateway https://api.layerx1.com primary model lx1-deepseek-v4-flash small / fast lx1-glm-4.7-flash key lx1_YO••••••••••KEY tools Claude Code, OpenAI Codex CLI Write these configs? [Y/n] yes ✓ Claude Code → wrote ~/.claude/settings.json • If you previously logged in to Claude, run `/logout` once so the gateway key is used. • Then just run `claude`. ✓ OpenAI Codex CLI → wrote ~/.codex/config.toml • The API key is in the provider block — Codex Desktop does not need LAYERX1_API_KEY. • Codex requires the Responses API — Layer X1 serves /v1/responses. • Then run `codex`. ✓ gateway replied in 412ms · served by lx1-deepseek-v4-flash ──────────────────────────────────────────────────────── You're set. → Claude Code claude → OpenAI Codex CLI codex → check anytime npx layerx1 status
Per-tool setup guides →
Put your agent on inference built for the work

Your agent stays the same.
Its inference gets better.

$export ANTHROPIC_BASE_URL=https://api.layerx1.com

Start free · no card · Starter from $5/mo