Google · Benchmarks

Gemma 4 31B benchmarks

Gemma 4 31B has 9 published scores in this dataset, from a Google release dated 2026-04-02. Its composite index is 79.2, which places it 16th of 22 ranked models and 11th among 15 open-weight models. Its strongest area is knowledge (index 92.5) and its weakest is agentic (index 68.9). Its best placing is on τ²-bench, where its 76.9 ranks 1st of 2 models with a published score.

OpenLLM Buddy runs gemma-4-31B-it-uncensored, an uncensored fine-tune of Gemma 4 31B, on RTX 4090 24GB (24 GB VRAM). The scores below are the official base model's; a fine-tune can score slightly differently.

Category profile

Index 0–100: each score relative to the best published score on that test.

Model facts

Lab
Google
Type
OpenLLM Buddy catalog
Released
2026-04-02
Parameters
30.7B dense
Context
256K
License
Apache-2.0
Runs on
RTX 4090 24GB

Gemma 4 31B hardware requirements and cost

At 4-bit it needs about 21 GB, which fits a single RTX 4090, so it can run on a home workstation with llama.cpp, Ollama, or vLLM. Full BF16 precision needs about 71 GB (1× H100 (80 GB)).

Estimated GPU memory for Gemma 4 31B
PrecisionWeightsWith headroomSmallest setup
BF16 (full precision)61 GB71 GB1× H100 (80 GB)
FP8 / 8-bit31 GB35 GB1× H100 (80 GB)
4-bit (GGUF Q4_K_M)18 GB21 GBRTX 4090 (24 GB)

Estimate: parameters × bytes per parameter, plus 15% for the KV cache and runtime at modest context lengths. Long contexts and large batches need more.

On OpenLLM Buddy: gemma-4-31B-it-uncensored runs on RTX 4090 24GB, with an OpenAI-compatible API and no per-token fees. Prices start at $13 USD for 11 hours.

  • 11 hours: $13 USD
  • 24 hours: $27 USD
  • 1 week: $184 USD
  • 1 month: $736 USD
Deploy Gemma 4 31B

Lighter or stronger open models

Open models ranked just above and below on the composite index, with their 4-bit memory needs.

Gemma 4 31B speed and pricing

Measured figures link to their source; estimates are labelled.

API output speed
35 tok/sArtificial Analysis median · Artificial Analysis
Time to first token
0.76 sOpenRouter model page provider stats
API price per 1M tokens
$0.100 in · $0.340 outcheapest provider on OpenRouter: CoreWeave · OpenRouter endpoints API
Speed on OpenLLM Buddy (RTX 4090, 4-bit)estimate
25–34 tok/s
OpenLLM Buddy GPU rental
from $1.10 per hourflat rate, no per-token fees
Cost per 1M output tokens, one userestimate
≈ $10.20falls sharply when several requests share the GPU
On your own RTX 4090 (4-bit)estimate
25–34 tok/s

Estimate for one user on one GPU: active weights read per token ÷ memory bandwidth at 50–70% efficiency, plus 3 ms overhead per token. Real speed varies with engine, context length and quantization; serving several users at once raises total throughput.

Compare speed and price across all models

Score by test

Rank is among every model with a published score on that test.

Sources

Scores are published results from model cards, lab reports, and public leaderboards, each linked to its source. Settings such as thinking mode or test version differ between sources and are shown next to each score. OpenLLM Buddy catalog models are uncensored fine-tunes; their scores are those of the official base model. Data collected 2026-10-30. How the index works