Hardware guide for local AI
32 pages. Every graphics card we have arithmetic for, and which of the eleven models fit in it. Only one of these cards has been timed, and its pages say so.
- Local AI on Intel Arc A770: which models run and how fast
- Local AI on Intel Arc B580: which models run and how fast
- Local AI on CPU only: which models run and how fast
- Local AI on GTX 1660 Ti: which models run and how fast
- Local AI on Intel Iris Xe: which models run and how fast
- Local AI on Apple M1: which models run and how fast
- Local AI on Apple M2: which models run and how fast
- Local AI on Apple M3: which models run and how fast
- Local AI on Apple M4: which models run and how fast
- Local AI on Apple M4 Pro: which models run and how fast
- Local AI on Radeon 780M integrated: which models run and how fast
- Local AI on RTX 2060: which models run and how fast
- Local AI on RTX 3050: which models run and how fast
- Local AI on RTX 3060 12GB: which models run and how fast
- Local AI on RTX 3060 Laptop: which models run and how fast
- Local AI on RTX 3070: which models run and how fast
- Local AI on RTX 3080: which models run and how fast
- Local AI on RTX 3090: which models run and how fast
- Local AI on RTX 4050 Laptop: which models run and how fast
- Local AI on RTX 4060: which models run and how fast
- Local AI on RTX 4070: which models run and how fast
- Local AI on RTX 4080: which models run and how fast
- Local AI on RTX 4090: which models run and how fast
- Local AI on RTX 5060 Ti: which models run and how fast
- Local AI on RTX 5070: which models run and how fast
- Local AI on RTX 5070 Ti: which models run and how fast
- Local AI on RTX 5080: which models run and how fast
- Local AI on RTX 5090: which models run and how fast
- Local AI on Radeon RX 6600: which models run and how fast
- Local AI on Radeon RX 7600: which models run and how fast
- Local AI on Radeon RX 7900 XTX: which models run and how fast
- Local AI on Snapdragon X Elite: which models run and how fast