Reference · Sustainability

The carbon twin of $/M-token

Every token has an energy shadow. This is a modeled estimate of the electricity (kWh) and emissions (gCO₂) per million output tokens for AI models with disclosed active-parameter counts, normalized on a reference accelerator. Like our sizing and teardowns: modeled, assumptions published — best for relative comparison, not a billed figure.

Assumptions: reference accelerator NVIDIA Rubin Ultra VR300 (32,000 GB/s HBM, 3600 W) · memory-bound decode at 50% MBU · batch 32 · 2-byte weights (FP16) · PUE 1.2 · grid 250 gCO₂/kWh (EU).
ModelVendorActive paramskWh / MtokgCO₂ / Mtok$ / Mtok
Gemma 3 1BGoogle1B0.0041.2—
Llama 3.2 1BMeta1B0.0041.2—
Gemma 2 2BGoogle2B0.0082.3—
Qwen 3 30B (MoE)Alibaba3B0.0123.5$0.50
Qwen2.5 3BAlibaba3B0.0123.5—
Llama 3.2 3BMeta3B0.0123.5—
Gemma 3 4BGoogle4B0.0164.7—
Mistral 7BMistral7B0.0298.6—
LLaMA 3 8BMeta8B0.0319.4—
Llama 3.1 8BMeta8B0.0319.4—
Gemma 3 12BGoogle12B0.04714.1—
LLaMA 4 ScoutMeta17B0.06619.9$0.30
LLaMA 4 MaverickMeta17B0.06619.9$0.80
o4-miniOpenAI20B0.07823.4$4.40
Qwen 3 235B (MoE)Alibaba22B0.08625.8$1.82
Gemma 3 27BGoogle27B0.10531.6$0.33
DeepSeek R1DeepSeek37B0.14543.4$2.50
DeepSeek V3DeepSeek37B0.14543.4$0.80
DeepSeek-V3 (MoE)DeepSeek37B0.14543.4—
Mixtral 8x22B (MoE)Mistral39B0.15245.7—
Mixtral 8x22BMistral39B0.15245.7$6
GPT-4oOpenAI50B0.19558.6$10
o3OpenAI50B0.19558.6$8
Gemini 2.5 FlashGoogle60B0.23470.3$2.50
LLaMA 3 70BMeta70B0.27382.0—
Claude Haiku 3.5Anthropic70B0.27382.0$4
Llama 3.1 70BMeta70B0.27382.0—
Qwen 2.5 72BAlibaba72B0.28184.4$0.40
Grok-2xAI80B0.31393.8$10
Command R+Cohere104B0.406122$10
Claude Sonnet 4Anthropic120B0.469141$15
Mistral Large 2Mistral123B0.480144$1.50
Gemini 2.5 ProGoogle300B1.17352$10
GPT-4.5OpenAI300B1.17352$15
Grok-3xAI300B1.17352$15
Claude Opus 4Anthropic350B1.37410$75
LLaMA 3.1 405BMeta405B1.58475—
Llama 3.1 405BMeta405B1.58475—
Kimi K3Moonshot2800B10.943,281$15

Sorted most-efficient first. Only models with a disclosed active-parameter count are shown (39 of 46); most closed models don't publish parameters.

How it's modeled

Decode is memory-bandwidth-bound: each output token reads the model's active parameters from HBM once, amortized across the serving batch. So energy/token ≈ chip power ÷ (per-stream throughput × batch), where per-stream throughput = (HBM bandwidth × MBU) ÷ (active params × bytes/param). Emissions = energy × PUE × grid carbon intensity. Real serving efficiency varies widely with batch size, precision, hardware and grid — treat these as directional. Terms: MBU, PUE, grid carbon intensity, gCO₂ per token.

Model your workload's footprint precisely

For your actual model, chip, batch and region, the sizing report computes energy, cost and $/M-token together.

Modeled estimate; methodology above. Not investment or sustainability-reporting advice. Methodology.