GPUFits

GPU Compatibility Checker

Two-way GPU compatibility checker: pick a model to see which GPUs run it (single or multi-card), or pick a GPU to see which models it runs, with speed estimates.

GPU Compatibility Checker
3.9GB
Llama 3.2 3.21B · Q4_K_M · 4K
  • rtx-3060-12gb✅ Comfortable
    3.9 / 12 GB
    ~137 tok/s$180 used
  • rtx-4070-ti-super✅ Comfortable
    3.9 / 16 GB
    ~256 tok/s$550 used
  • rx-7900-xtx✅ Comfortable
    3.9 / 24 GB
    ~366 tok/s$650 used
  • rtx-3090✅ Comfortable
    3.9 / 24 GB
    ~357 tok/s$1,000 used
  • rtx-4090✅ Comfortable
    3.9 / 24 GB
    ~385 tok/s$1,100 used
  • mac-mini-m4-pro-48gb✅ Comfortable
    3.9 / 36 GB
    ~104 tok/s$1,799 MSRP
  • rtx-5090✅ Comfortable
    3.9 / 32 GB
    ~684 tok/s$1,999 MSRP
  • rtx-a6000✅ Comfortable
    3.9 / 48 GB
    ~293 tok/s$2,800 used
  • mac-studio-m4-max-64gb✅ Comfortable
    3.9 / 48 GB
    ~208 tok/s$2,899 MSRP
  • mac-studio-m3-ultra-96gb✅ Comfortable
    3.9 / 72 GB
    ~312 tok/s$5,299 MSRP
  • a100-80gb✅ Comfortable
    3.9 / 80 GB
    ~778 tok/s$15,000 MSRP
  • h100-80gb✅ Comfortable
    3.9 / 80 GB
    ~1278 tok/s$30,000 MSRP

Nothing local works? Rent a cloud GPU instead

Cloud GPU deals · Vast.ai

Theoretical estimates; real-world speed varies ±30% with framework, drivers, and CPU. Prices are manual reference prices with verification dates.