deeprelay chat

Run a chat completion (streams tokens by default)

Synopsis

Runs a chat completion against a serverless model and streams the response tokens to stdout. The prompt comes from -m/--message flags, trailing arguments, or piped stdin (in that order). Append :economy to the model id to use the economy tier. Requires a key with the serverless:write scope.

Chat writes the model's text to stdout and ignores --output (it is not a structured resource). Use --no-stream to print the full response at once.

Examples

# One-shot prompt as arguments (streams the reply)
deeprelay chat deeprelay/deepseek-v4-flash "Explain WireGuard in one sentence"

# System prompt + sampling controls
deeprelay chat deeprelay/deepseek-v4-flash -m "Write a haiku about GPUs" --system "You are concise." --temperature 0.7

# Economy tier
deeprelay chat deeprelay/deepseek-v4-flash:economy "hello"

# Pipe the prompt in from stdin
echo "Summarize WireGuard." | deeprelay chat deeprelay/deepseek-v4-flash

# Non-streaming (print the full response at once)
deeprelay chat deeprelay/deepseek-v4-flash "hi" --no-stream

deeprelay chat <model> [prompt...] [flags]

Options

  -h, --help                  help for chat
      --max-tokens int        Maximum completion tokens
  -m, --message stringArray   User message (repeatable); alternative to a positional prompt
      --no-stream             Disable streaming; print the full response
      --system string         Optional system prompt
      --temperature float     Sampling temperature

Options inherited from parent commands

      --api-base string   API base URL (override with DEEPRELAY_API_BASE env) (default "https://api.deeprelay.ai/v1")
      --debug             Enable debug logging to stderr
      --no-preflight      Skip the plan/credit check before inference requests (override with DEEPRELAY_NO_PREFLIGHT env)
  -o, --output string     Output format: table|json (default table on TTY, json otherwise) (default "table")

SEE ALSO

• deeprelay - deeprelay command-line interface