On-device AI
Short answer
On-device AI means the model runs on the hardware in front of you — your laptop, your phone — rather than on a server you send a request to.
The term has been stretched by marketing. Several products described as on-device run a small model locally for simple tasks and silently forward anything harder to a server, which is a reasonable engineering choice and a misleading label.
The question worth asking of any such product is not whether it has a local model, but whether there is any condition under which your data leaves. Nightjar's answer is no, which is why it will tell you a question is beyond the local model rather than quietly escalating it.
Related terms
Other ways people ask this
- what is on device ai