Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.tensormesh.ai/llms.txt

Use this file to discover all available pages before exploring further.

​
When To Use This

Use tm infer completions when you want the text-completions endpoint instead of chat completions. Provide the request body as JSON and either include model in the body or pass --model to override it.

​
Usage

tm infer completions [OPTIONS]

​
Examples

​
Send a serverless text-completions request.

tm infer completions --api-key YOUR_INFERENCE_API_KEY --model YOUR_SERVERLESS_MODEL_NAME --json '{"prompt":"Say hello."}'

​
Stream text-completion tokens over SSE and fail a stalled stream after 30 seconds of upstream silence.

tm infer completions --stream --stream-idle-timeout 30 --api-key YOUR_INFERENCE_API_KEY --model YOUR_SERVERLESS_MODEL_NAME --json '{"prompt":"Stream a short reply."}'

​
Options

NameTypeRequiredDefaultDetails
--surfacechoice[serverless]no"serverless"Inference surface to target.
--modeltextnoModel name to use. Overrides model in the JSON request body.
--api-keytextnoInference API key (Authorization: Bearer …).
--base-urltextnoOverride the base URL for the selected surface.
--streambooleannofalseStream tokens via SSE. Boolean flag.
--stream-idle-timeoutfloatno300.0Maximum idle read timeout in seconds for —stream responses.
--jsontextnoJSON request body or @file.json. When omitted, reads piped stdin if available.
--filepathnoRead JSON request body from file.
--timeoutfloatnoHTTP connect timeout in seconds for the inference request.

​
Inherited Global Options

NameTypeRequiredDefaultDetails
--version, -VbooleannofalseShow the version and exit. Boolean flag.
--configpathno"~/.config/tensormesh/config.toml"Path to config TOML file
--output`choice[textjsonyamlrawtable]`no"text"Output format (text is human-readable; json is machine-friendly).
--quietbooleannofalseSuppress non-essential output. Boolean flag.
--debugbooleannofalsePrint debug logs to stderr (secrets redacted). Boolean flag.
--ca-bundlepathnoPath to a PEM CA bundle for TLS verification (overrides TENSORMESH_CA_BUNDLE).
--max-retriesintegernoMax retries for idempotent HTTP requests on transient errors (overrides TENSORMESH_MAX_RETRIES; subcommands may override).
--controlplane-basetextnoOverride the Control Plane base URL.

​
Auth Scope

  • inference-api-key

​
Caveats

  • --model overrides the model field inside the JSON request body.
  • --stream currently supports only --output text.

​
Parent Command