Hardware Detail GPUPrevious gen

NVIDIA L40S 48GB

NVIDIA L40S 48GB profile for local AI model planning.

NVIDIANVIDIA GPU2023-0848GB VRAM
AI Memory
48GB VRAM
Runtime headroom is estimated.
LLM Score
78
server
Power
310W
Average AI load
Value Score
6.4
Planner signal

Task Fit

Vision97

Strong fit for vision workloads in the current planner.

Image generation97

Strong fit for image generation workloads in the current planner.

Chat96

Strong fit for chat workloads in the current planner.

Code94

Strong fit for code workloads in the current planner.

RAG94

Strong fit for rag workloads in the current planner.

Agent91

Strong fit for agent workloads in the current planner.

Video generation82

Usable for video generation, with tradeoffs around speed, memory, or runtime maturity.

Embedding75

Usable for embedding, with tradeoffs around speed, memory, or runtime maturity.

Voice71

Usable for voice, with tradeoffs around speed, memory, or runtime maturity.

Runtime Support

ollamaExcellent
llama.cppExcellent
LM StudioExcellent
vllmExcellent
sglanggood
ComfyUIExcellent
diffusersExcellent

Specs

CPU cores—
GPU cores—
System RAM—
Unified memory—
VRAM48GB
Usable model memory48GB
CUDASupported
MetalNo
ROCmNo

Cost and Ops

Hardware price$7,500
Build cost$1,800
UPS / accessories$200
5-year estimate$10,386
Expected lifespan6 years
Residual value18%
Build requiredYes

Models This Hardware Can Run

Estimated from default model artifacts, VRAM, unified memory, and recommended RAM.

62 compatible defaults
DeepSeek-R1-Distill 70B
Compatible

DeepSeek · Q4_K_M

80GB recommended
DeepSeek-R1-Distill 32B
Compatible

DeepSeek · Q4_K_M

48GB recommended
Qwen3 235B-A22B
Compatible

Alibaba · Q2_K

192GB recommended
Phi-4 14B
Compatible

Microsoft · Q4_K_M

24GB recommended
GLM 5.1 FP8
Compatible

Z.ai · FP8

96GB recommended
GLM 4.7 Flash
Compatible

Z.ai · Q4_K_M

32GB recommended
Kimi K2.7 Code
Compatible

Moonshot AI · Q4_K_M

48GB recommended
Kimi K2.6
Compatible

Moonshot AI · Q4_K_M

48GB recommended
Kimi K2 Thinking
Compatible

Moonshot AI · Q4_K_M

48GB recommended

Best For

rack serversvLLMteam inference

NVIDIA L40S 48GB profile for local AI model planning.

Source Confidence

Specsreviewed
PriceEstimated
PowerEstimated
PerformanceEstimated
Updated2026-06-18

Similar Hardware

NVIDIA RTX 6000 Blackwell 96GB
NVIDIA · 96GB VRAM · $12,376 / 5y

NVIDIA RTX 6000 Blackwell 96GB profile for local AI model planning.

NVIDIA A100 80GB
NVIDIA · 80GB VRAM · $12,156 / 5y

NVIDIA A100 80GB profile for local AI model planning.

NVIDIA RTX 6000 Ada 48GB
NVIDIA · 48GB VRAM · $9,111 / 5y

NVIDIA RTX 6000 Ada 48GB profile for local AI model planning.