Hardware
Bare cards are here for reference. Recommendations use complete PCs and Macs only. Prices are indicative as of 14 Oct 2026 and have no shop source.
Setups
| Name | Memory | Bandwidth | Price | Bandwidth source |
|---|---|---|---|---|
Budget PC with RTX 3060 12GB Entry point for 8B and, just barely, 14B Q4. The card is mostly second-hand. used | 12 GBVRAM | 360 GB/s | €890 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mid-range PC with RTX 4060 Ti 16GB 16 GB is comfortable for 14B. Bandwidth is lower than a 3060, so 8B is not automatically faster. | 16 GBVRAM | 288 GB/s | €1,490 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Used PC with RTX 3090 24GB Best single card here for 32B Q4. 70B Q4 does not fully fit. used | 24 GBVRAM | 936 GB/s | €1,280 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
PC with Radeon RX 7900 XTX 24GB Same memory as a 3090/4090. The estimate uses lower utilization because the software stack is less smooth. | 24 GBVRAM | 960 GB/s | €1,790 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
PC with RTX 4090 24GB Fast for everything up to about 32B. Not a 70B machine, whatever the box costs. | 24 GBVRAM | 1008 GB/s | €2,890 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
PC with RTX 5090 32GB Highest bandwidth in a single card. 32 GB is plenty for 32B, still too tight for 70B Q4. | 32 GBVRAM | 1792 GB/s | €4,490 14 Oct 2026 estimate | www.nvidia.com/en-eu/geforce/graphics-cards/50-series/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Dual RTX 3090, 48 GB The classic 70B Q4 rig. Two cards, more hassle, enough memory. used | 48 GBVRAM | 1872 GB/s | €1,980 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Dual RTX 4090, 48 GB Same memory as two 3090s, higher bandwidth, a lot more money. | 48 GBVRAM | 2016 GB/s | €5,490 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac mini M4 16GB Quiet and cheap for 8B Q4. Not for 32B or 70B. used | 16 GBunified | 120 GB/sestimate | €549 14 Oct 2026 estimate | estimate Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac mini M4 Pro 64GB Enough memory for 70B Q4, but bandwidth is modest. It fits; it is not fast. used | 64 GBunified | 273 GB/sestimate | €1,890 14 Oct 2026 estimate | estimate Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac Studio M4 Max 36GB Previous Studio generation. 36 GB is a solid 32B machine, not 70B Q4. used | 36 GBunified | 410 GB/s | €1,890 14 Oct 2026 estimate | support.apple.com/en-us/122211 Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac Studio M4 Max 128GB 70B Q4 and Q5 fit, Q8 often does too. Slower than a dual 3090, much quieter. used | 128 GBunified | 546 GB/s | €3,290 14 Oct 2026 estimate | support.apple.com/en-us/122211 Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac mini M6 16GB Current entry mini. Fine for 8B, too tight for 32B. | 16 GBunified | 153 GB/s | €799 14 Oct 2026 estimate | www.apple.com/mac-mini/specs/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac mini M6 32GB 32B Q4 fits, 70B does not. Apple lists 170 GB/s for the higher memory configuration. | 32 GBunified | 170 GB/s | €1,249 14 Oct 2026 estimate | www.apple.com/mac-mini/specs/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac mini M5 Pro 64GB 70B Q4 fits in 64 GB unified memory. Faster than an M4 Pro, slower than two 3090s. | 64 GBunified | 307 GB/s | €2,790 14 Oct 2026 estimate | www.apple.com/mac-mini/specs/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac Studio M5 Max 36GB Current Studio entry. Strong for 32B, not enough memory for 70B Q4. | 36 GBunified | 460 GB/s | €2,590 14 Oct 2026 estimate | www.apple.com/mac-studio/specs/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac Studio M5 Max 128GB 70B up to Q8 has room here. Bandwidth still trails a dual high-end GPU. | 128 GBunified | 614 GB/s | €5,190 14 Oct 2026 estimate | www.apple.com/mac-studio/specs/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac Studio M5 Ultra 96GB High bandwidth and enough memory for 70B Q4/Q5. FP16 70B does not fit. | 96 GBunified | 1200 GB/s | €6,490 14 Oct 2026 estimate | www.apple.com/mac-studio/specs/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Mac Studio M5 Ultra 256GB The machine in this list that can still hold 70B in FP16. The price is a rough estimate. | 256 GBunified | 1200 GB/s | €10,490 14 Oct 2026 estimate | www.apple.com/mac-studio/specs/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Bare cards
| Name | Memory | Bandwidth | Price | Bandwidth source |
|---|---|---|---|---|
GeForce RTX 3060 12GB Card only. 12 GB covers 7B–8B and is tight for 14B Q4. used | 12 GBVRAM | 360 GB/s | €280 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
GeForce RTX 4060 Ti 16GB Card only. A lot of VRAM for the power draw, but a narrow bus: 288 GB/s. | 16 GBVRAM | 288 GB/s | €460 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
GeForce RTX 3090 24GB Used card only. 24 GB and a wide bus. One card is not enough for 70B Q4. used | 24 GBVRAM | 936 GB/s | €720 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
GeForce RTX 4090 24GB Card only. Fast, but still 24 GB. 70B Q4 does not fully fit. | 24 GBVRAM | 1008 GB/s | €1,850 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
GeForce RTX 5090 32GB Card only. 32 GB GDDR7 according to NVIDIA. Still too small for 70B Q4. | 32 GBVRAM | 1792 GB/s | €2,790 14 Oct 2026 estimate | www.nvidia.com/en-eu/geforce/graphics-cards/50-series/ Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |
Radeon RX 7900 XTX 24GB Card only. Same memory class as a 4090; the estimate assumes a slower software stack. | 24 GBVRAM | 960 GB/s | €920 14 Oct 2026 estimate | manufacturer, no URL stored Indicative EU price incl. VAT (BE/NL). No shop listing was checked. |