One RTX 3090 FE
per second
— output tokens · — seconds
Open the source record ↗THE RESULTS / 01
What changes when a model runs on one RTX 3090 FE or a connected pair? Explore one example from the lab, then open the evidence behind it.
THE SIMPLE VIEW
— output tokens · — seconds
Open the source record ↗— output tokens · — seconds
Open the source record ↗—
—
THE CONTEXT
A token is a piece of text used by a language model. Tokens per second describe output speed for this particular request; they are not a measure of answer quality.
The pair has 24 GB on each card. Software must distribute the workload across the cards; connecting them does not turn them into one GPU. The lab has two independent pairs, each in its own virtual machine.
THE EXPERT VIEW
The two run files are the source of the values above. Their settings are shown together so differences are visible.
| Field | One GPU | NVLink pair |
|---|---|---|
| Loading… | ||
Different models, prompts, software settings and hardware can produce different results. The comparison does not isolate the effect of NVLink, and says nothing about quality or total system energy use.
KEEP EXPLORING