Hardware Detail GPUPrevious gen

NVIDIA H200 141GB

NVIDIA H200 141GB profile for local AI model planning.

NVIDIANVIDIA GPU2024-06141GB VRAM
AI Memory
141GB VRAM
Runtime headroom is estimated.
LLM Score
100
server
Power
560W
Average AI load
Value Score
5.3
Planner signal

Task Fit

Code100

Strong fit for code workloads in the current planner.

Chat100

Strong fit for chat workloads in the current planner.

RAG100

Strong fit for rag workloads in the current planner.

Vision100

Strong fit for vision workloads in the current planner.

Image generation100

Strong fit for image generation workloads in the current planner.

Agent97

Strong fit for agent workloads in the current planner.

Video generation88

Strong fit for video generation workloads in the current planner.

Embedding80

Usable for embedding, with tradeoffs around speed, memory, or runtime maturity.

Voice75

Usable for voice, with tradeoffs around speed, memory, or runtime maturity.

Runtime Support

ollamaExcellent
llama.cppExcellent
LM StudioExcellent
vllmExcellent
sglanggood
ComfyUIExcellent
diffusersExcellent

Specs

CPU cores—
GPU cores—
System RAM—
Unified memory—
VRAM141GB
Usable model memory141GB
CUDASupported
MetalNo
ROCmNo

Cost and Ops

Hardware price$32,000
Build cost$3,200
UPS / accessories$200
5-year estimate$37,162
Expected lifespan6 years
Residual value18%
Build requiredYes

Models This Hardware Can Run

Estimated from default model artifacts, VRAM, unified memory, and recommended RAM.

62 compatible defaults
DeepSeek-R1-Distill 70B
Compatible

DeepSeek · Q4_K_M

80GB recommended
DeepSeek-R1-Distill 32B
Compatible

DeepSeek · Q4_K_M

48GB recommended
Qwen3 235B-A22B
Compatible

Alibaba · Q2_K

192GB recommended
Phi-4 14B
Compatible

Microsoft · Q4_K_M

24GB recommended
GLM 5.1 FP8
Compatible

Z.ai · FP8

96GB recommended
GLM 4.7 Flash
Compatible

Z.ai · Q4_K_M

32GB recommended
Kimi K2.7 Code
Compatible

Moonshot AI · Q4_K_M

48GB recommended
Kimi K2.6
Compatible

Moonshot AI · Q4_K_M

48GB recommended
Kimi K2 Thinking
Compatible

Moonshot AI · Q4_K_M

48GB recommended

Best For

enterprise servinghuge VRAMlong-context RAG

NVIDIA H200 141GB profile for local AI model planning.

Source Confidence

Specsreviewed
PriceEstimated
PowerEstimated
PerformanceEstimated
Updated2026-06-18

Similar Hardware

NVIDIA RTX 6000 Blackwell 96GB
NVIDIA · 96GB VRAM · $12,376 / 5y

NVIDIA RTX 6000 Blackwell 96GB profile for local AI model planning.

NVIDIA A100 80GB
NVIDIA · 80GB VRAM · $12,156 / 5y

NVIDIA A100 80GB profile for local AI model planning.

NVIDIA H100 80GB
NVIDIA · 80GB VRAM · $29,822 / 5y

NVIDIA H100 80GB profile for local AI model planning.