Skip to content

On-device AI

Short answer

On-device AI means the model runs on the hardware in front of you — your laptop, your phone — rather than on a server you send a request to.

The term has been stretched by marketing. Several products described as on-device run a small model locally for simple tasks and silently forward anything harder to a server, which is a reasonable engineering choice and a misleading label.

The question worth asking of any such product is not whether it has a local model, but whether there is any condition under which your data leaves. Nightjar's answer is no, which is why it will tell you a question is beyond the local model rather than quietly escalating it.

Related terms

Other ways people ask this

  • what is on device ai

Related