Skip to content

Local AI on Apple M2: which models run and how fast

Short answer

Apple M2 has no dedicated video memory, so models run on the CPU in system RAM. The small models are usable there; the large ones are not.

Video memory
none, shared with system RAM
Models that fit fully
0 of 11
Largest that fits
none — CPU only
This is our test card
no

Every model against this card

What the numbers here are and are not

The fit is arithmetic — a file size against a memory size, with about 1.1 GB added for context and runtime. The speeds elsewhere on this site were measured on RTX 3060 12 GB, Vulkan backend and nowhere else. Where a page says a figure was not measured, that is literal: we would rather leave a gap than publish an estimate that reads like a result.

Other ways people ask this

  • best local llm for apple m2
  • apple m2 llm tokens per second
  • I have a Apple M2. Which local model should I run for browser AI?

Related