Graphics cards for running language models locally, new and used. VRAM and bus width come from NVIDIA spec pages and launch prices from NVIDIA press releases; we explain which cards fit which models and where used cards make sense.
6 articles
Best GPU for Local LLMs (by Budget)
How to choose a GPU for running LLMs locally: VRAM first, then bandwidth, with cited specs and launch prices for…
Read →Best Used GPUs for AI
Why used 24 GB GPUs like the RTX 3090 are popular for local LLMs, what to check before buying, and how they…
Read →GeForce RTX 5060 VRAM
The GeForce RTX 5060 has 8 GB of VRAM. What that means for games and local AI models, with cited…
Read →GeForce RTX 5070 VRAM
The GeForce RTX 5070 has 12 GB of VRAM. What that means for games and local AI models, with cited…
Read →GeForce RTX 5080 VRAM
The GeForce RTX 5080 has 16 GB of VRAM. What that means for games and local AI models, with cited…
Read →Best Laptops for Local LLMs
How to pick a laptop for running LLMs locally: GPU VRAM, unified memory, and the trade-offs of mobile GPUs and…
Read →