SGLang Provider

기준일: 2026-07-26
난이도: 중급
공식 기준: SGLang

개요

이 페이지는 OpenClaw SGLang provider의 인증, 모델 ref, 온보딩 플래그, 설정 키를 공식 문서 기준으로 정리합니다.

공식 요약: Run OpenClaw with SGLang (OpenAI-compatible self-hosted server)

model ref는 보통 provider/model 형식입니다. API key·endpoint·model id는 아래 원문 값을 그대로 쓰세요. 임의로 키나 엔드포인트를 만들지 마세요.

빠른 참조

Property	Value
Provider id	sglang
Plugin	bundled, enabledByDefault: true
Auth env var	SGLANG_API_KEY (any non-empty value if server has no auth)
Onboarding flag	--auth-choice sglang
API	OpenAI-compatible (openai-completions)
Default base URL	http://127.0.0.1:30000/v1
Default model placeholder	sglang/Qwen/Qwen3-8B
Streaming usage	Yes (supportsStreamingUsage: true)
Pricing	Marked external-free (modelPricing.external: false)

공식 문서 기반 상세

아래는 공식 providers/sglang 문서를 Mintlify 컴포넌트만 정리하고 공통 제목을 한국어로 맞춘 내용입니다. 설정 키, env, model ref, CLI 플래그는 원문 그대로 유지합니다.

SGLang serves open-weight models via an OpenAI-compatible HTTP API. OpenClaw connects to SGLang using the openai-completions provider family with auto-discovery of available models.

Property	Value
Provider id	sglang
Plugin	bundled, enabledByDefault: true
Auth env var	SGLANG_API_KEY (any non-empty value if server has no auth)
Onboarding flag	--auth-choice sglang
API	OpenAI-compatible (openai-completions)
Default base URL	http://127.0.0.1:30000/v1
Default model placeholder	sglang/Qwen/Qwen3-8B
Streaming usage	Yes (supportsStreamingUsage: true)
Pricing	Marked external-free (modelPricing.external: false)

OpenClaw also auto-discovers available models from SGLang when you opt in with SGLANG_API_KEY. Use sglang/* in agents.defaults.models to keep discovery dynamic when you also configure a custom SGLang base URL. See Model discovery (implicit provider) below.

시작하기

Start SGLang

Launch SGLang with an OpenAI-compatible server. Your base URL should expose
`/v1` endpoints (for example `/v1/models`, `/v1/chat/completions`). SGLang
commonly runs on:

- `http://127.0.0.1:30000/v1`

Set an API key

Any value works if no auth is configured on your server:

```bash
export SGLANG_API_KEY="sglang-local"
```

Run onboarding or set a model directly

```bash
openclaw onboard
```

Or configure the model manually:

```json5
{
  agents: {
    defaults: {
      model: { primary: "sglang/your-model-id" },
    },
  },
}
```

Model discovery (implicit provider)

When SGLANG_API_KEY is set (or an auth profile exists) and you do not define models.providers.sglang, OpenClaw queries:

• GET http://127.0.0.1:30000/v1/models

and converts the returned IDs into model entries.

If you set models.providers.sglang explicitly, OpenClaw uses your declared models by default. Add "sglang/*": {} to agents.defaults.models when you want OpenClaw to query that configured provider's /models endpoint and include all advertised SGLang models.

Explicit configuration (manual models)

Use explicit config when:

• SGLang runs on a different host/port.
• You want to pin contextWindow/maxTokens values.
• Your server requires a real API key (or you want to control headers).

{
  models: {
    providers: {
      sglang: {
        baseUrl: "http://127.0.0.1:30000/v1",
        apiKey: "${SGLANG_API_KEY}",
        api: "openai-completions",
        models: [
          {
            id: "your-model-id",
            name: "Local SGLang Model",
            reasoning: false,
            input: ["text"],
            cost: { input: 0, output: 0, cacheRead: 0, cacheWrite: 0 },
            contextWindow: 128000,
            maxTokens: 8192,
          },
        ],
      },
    },
  },
}

고급 설정

Proxy-style behavior

SGLang is treated as a proxy-style OpenAI-compatible `/v1` backend, not a
native OpenAI endpoint.

| Behavior | SGLang |
|----------|--------|
| OpenAI-only request shaping | Not applied |
| `service_tier`, Responses `store`, prompt-cache hints | Not sent |
| Reasoning-compat payload shaping | Not applied |
| Hidden attribution headers (`originator`, `version`, `User-Agent`) | Not injected on custom SGLang base URLs |

문제 해결

**Server not reachable**

Verify the server is running and responding:

```bash
curl http://127.0.0.1:30000/v1/models
```

**Auth errors**

If requests fail with auth errors, set a real `SGLANG_API_KEY` that matches
your server configuration, or configure the provider explicitly under
`models.providers.sglang`.

If you run SGLang without authentication, any non-empty value for SGLANG_API_KEY is sufficient to opt in to model discovery.

관련 문서

Choosing providers, model refs, and failover behavior.


Full config schema including provider entries.

검증 체크리스트

• openclaw models list --provider sglang 로 모델이 보이는지 확인
• 기본 model alias를 agents.defaults.model.primary에 설정했는지 확인
• API key / OAuth / 로컬 런타임 인증 경로를 공식 문서와 대조했는지 확인
• failover 시 데이터가 다른 provider로 이동할 수 있는지 검토

관련

• Provider 목록 인덱스
• 로컬 모델과 Provider
• 공식: Provider directory, Model providers