GPUS · SEPTEMBER 2026 INDEX
Pick the buy path, then the card.
The 24 GB used 3090 is still the local dense default for Qwen 3.8 27B Q4. A 5090 is a different question. Datacenter leftovers and burned used cards are skip-or-inspect, not a 27B default.
24 GB buy path
Used 3090 / 4090 class for the dense 27B default. 12–16 GB cards are guests with a shorter context, not a 200k agent floor.
- Used RTX 3090 Buying Guide (October 2026): $1,499 Sold, and When It Is Not the Value Pick On October 6, 2026 a used RTX 3090 sold for a $1,499 eBay median, about double the June and August observations still sitting on older LocalRig pages. It is still the value pick when the model fits in 24GB and you want discrete CUDA bandwidth. It is not the cheapest dollar per gigabyte once 128GB mini PCs and Macs are in the comparison.
- RTX 4090 for Local LLMs in 2026: Great Card, Broken Price On October 6, 2026 a used RTX 4090 sold for a $3,000 eBay median and a used RTX 3090 for $1,499. Same 24GB. About 2.00× the card money, not the June 2.5× gap. Community 7B tok/s from 2024–2025 were not re-run.
- Two Used RTX 3090s vs One RTX 4090: Same Card Money, Twice the VRAM On October 6, 2026 two used RTX 3090s at the sold median were $2,998 in cards for 48GB, and one used RTX 4090 at the sold median was $3,000 for 24GB. The decision is still whether the model fits in 24GB. The old "pair costs less" claim does not survive the October sold medians.
- RTX 3060 12GB for Local LLMs: The Honest Entry Point Under $300 A 12GB VRAM card for under $300 can run 7B–8B models comfortably at Q4 quantization. This is the right first GPU when budget rules everything; the wrong choice if you already know you want bigger models. We show the model-fits math, the speed ceiling, and the upgrade path.
- RTX 4060 Ti 16GB vs 5060 Ti 16GB: The Budget Pick That Changed in Months The 4060 Ti 16GB was the default sub-$500 local LLM recommendation for two years. The 5060 Ti 16GB arrived near the same price with meaningfully better memory bandwidth, and bandwidth — not compute — is what token decode actually spends. Here is the price-conditional verdict, not a blanket "buy the new one."
- Best GPU Under $500 for Local LLMs in 2026, Ranked by Constraint At sub-$500, the GPU decision shifts from "what will fit" to "what will actually run without exploding the power supply." A constraint-ranked guide to the used 3060 12GB (safest default), Tesla P40 (VRAM-dense but cooling-complex), and the RTX 5060 Ti 16GB (best new-card path, just over budget).
New silicon / wait
5090, 2026 pricing, and VRAM-tier maps. A new card is not automatic over a used 3090.
- Is the RTX 5090 Worth It for Local AI in October 2026? $1,999 MSRP, $5,700 and $6,900 Street Launch MSRP is still $1,999 on the 15 October 2026 trackers. vga.live's store-sold low that day was $5,700. videocardprices.com's cheapest live street price was $6,900.00. Those are separate reads, not one range. This page reprices 32GB against a used 3090, an RTX PRO 6000, a 128GB Strix Halo box, a Mac Studio, and DGX Spark.
- Why GPU Prices Spiked Again in 2026: The DRAM Shortage, Explained 2026's GPU price spike is rooted in DRAM memory shortage, not a repeat of the 2021–22 crypto boom. AI datacenters are locking up supply years ahead; the timeline to clearance is uncertain. Your honest options: buy used, switch to AMD, rent instead, or wait—and the right choice depends on your workload and timeline, not scarcity pressure.
- Best GPU for Local LLM Inference (October 2026): Used 3090 for 24GB, Not for Every Budget A used RTX 3090 at the October 6, 2026 sold median of $1,499 is the value pick when the model fits in 24GB and you want CUDA bandwidth. A used 4090, a listed 5090, a Strix Halo mini PC, a Mac Studio, or a DGX Spark beats it in specific cases, and several of those prices are whole computers rather than cards.
- GPU VRAM Tiers for Local AI: What 8, 12, 16, 24, 48GB Actually Buy You A constraint-first selector that maps VRAM tiers—8GB, 12GB, 16GB, 24GB, 48GB—to the model classes they serve at usable quantization, with the heuristic to size your tier and the best-value GPU card per tier. No guesswork: know exactly which models fit where.
- Why VRAM (and Memory Bandwidth) Matters More Than Compute for Local LLMs The single concept that explains the used-GPU market: LLM inference—especially token generation—is memory-bandwidth-bound, not compute-bound. Older cards with fat VRAM beat newer cards with thin VRAM. Learn capacity vs. bandwidth vs. compute, and why a 2020 Tesla P40 or 2021 AMD MI50 often outperform newer GPUs for local inference on a budget.
Used oddballs
Inspect before you size a 27B download. P40 / MI50 / A6000 are not the homepage default.
- How to Buy a Used GPU Without Getting Burned: Vetting, Testing, and Red Flags The used GPU market holds real value — and real risk. This guide walks through seller red flags, the first-48-hours test protocol (VRAM testing, sustained load, thermals), and return-window discipline. Persona 2's defective VRAM module risk is why this page exists.
- Used RTX A6000 48GB for Local AI: The Single-Card Ceiling for 32B Models As enterprises refresh to Blackwell, used RTX A6000 prices on this page were last observed at $600–$1,200 and were not re-checked on 2026-10-06. Two used 3090s at CompSniper's $1,499 sold median are $2,998 in cards. That June claim that the A6000 has worse VRAM-per-dollar than the pair does not survive the October card price, and this page does not name an October winner.
- Tesla P40 in 2026: 24GB of VRAM for $150 — Legit Bargain or Trap? The Tesla P40 costs $150–200 used and holds 24GB of VRAM. It runs local LLMs, but passive cooling throttles hard without forced airflow, compute is ancient, and there is no video output. A constraint guide: right for the tinkering homelabber who enjoys the project; wrong for anyone who wants inference to work on day one.
- AMD MI50 32GB: The $150 HBM2 Wildcard for Local LLMs The MI50's June 2026 eBay band was $120–$210, about 8–14% of CompSniper's 6 October 2026 used RTX 3090 sold median of $1,499. That MI50 dollar was not re-checked. ROCm support is in maintenance mode, so drivers will not improve and may decay. A knowing bet for tinkerers; explicitly not a recommendation for anyone's only GPU.
- AMD 7900 XTX for Local LLMs in 2026: ROCm Finally Grew Up ROCm 7.2 (March 2026) closed the compatibility gap that used to make AMD a hard pass for local LLM inference. This guide covers what "parity" actually means for the 7900 XTX's 24GB, where it beats the RTX 4090 on price, where it loses on speed, and who should still buy CUDA.
- Is NVLink Worth It in 2026? The Dual-3090 Bridge Question, Answered NVLink is a $40–80 bridge with outsized mythology. For inference workloads that layer-split models across cards, it barely matters. For tensor-parallel serving it can. This guide separates the workloads where the bridge pays for itself from those where it's cargo cult tech.