> ## Documentation Index
> Fetch the complete documentation index at: https://vastai-80aa3a82-examples-openclaw-openai-serverless.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# vastai run benchmarks

Benchmark a template against one or more GPUs and report performance per dollar.

## Usage

```bash theme={null}
vastai run benchmarks [OPTIONS]
```

## Options

<ParamField path="--template_hash" type="string">
  Template hash to benchmark. One of `--template_hash` or `--template_id` is required.
</ParamField>

<ParamField path="--template_id" type="integer">
  Template ID to benchmark. Wins over `--template_hash` if both are passed. One of `--template_hash` or `--template_id` is required.
</ParamField>

<ParamField path="--gpus" type="string">
  Comma-separated GPU names, same format as `vastai search offers` (e.g. `RTX_4090,RTX_3090`). An optional `Nx` prefix per token requests a multi-GPU configuration (e.g. `"2x RTX_4090"`). Defaults to `RTX_5090,RTX_4090,RTX_3090,RTX_A6000`.
</ParamField>

<ParamField path="--num_gpus" type="integer">
  GPUs per instance for tokens without an `Nx` prefix. If omitted, the count is auto-sized from the template's `gpu_total_ram` filter so VRAM fits.
</ParamField>

<ParamField path="--timeout" type="integer" default="3600">
  Per-GPU safety ceiling in seconds. Each rental is torn down at this point even if no `measured_perf` was reported.
</ParamField>

<ParamField path="-y, --yes" type="flag">
  Skip the cost confirmation prompt.
</ParamField>

## Examples

```bash theme={null}
# auto-sweep the default GPUs
vastai run benchmarks --template_hash 79ebdd2ebfb9d42cedf7a221c42d37a5

# specific GPUs
vastai run benchmarks --template_hash 393fa8572e6c73c927c8275fe4dffd53 --gpus RTX_4090,RTX_3090

# multi-GPU configurations via inline Nx prefix
vastai run benchmarks --template_hash 40ef49becc953aa910ee05bd4653b9b3 --gpus "2x RTX_4090, 2x RTX_3090"

# raw JSON output for piping into another tool
vastai run benchmarks --template_hash 40ef49becc953aa910ee05bd4653b9b3 --raw
```

## Global Options

The following options are available for all commands:

| Option          | Description                                           |
| --------------- | ----------------------------------------------------- |
| `--url URL`     | Server REST API URL                                   |
| `--retry N`     | Retry limit                                           |
| `--raw`         | Output machine-readable JSON                          |
| `--explain`     | Verbose explanation of API calls                      |
| `--api-key KEY` | API key (defaults to `~/.config/vastai/vast_api_key`) |