Skip to content

An assistant that works with the wifi off

Short answer

Once a model is downloaded, the assistant works with no connection at all — on a plane, on a train, or on an air-gapped machine.

The problem it exists for

Cloud assistants are exactly as available as your connection, which is a problem in the places where uninterrupted reading time actually exists.

How it works

  • The model file and the inference engine are both local, so answering needs no network.
  • Documents already on the machine are read the same offline as online.
  • On an air-gapped machine, download the GGUF elsewhere and copy the file across.

What it does not do

  • Browsing needs a network; only the assistant works without one.
  • The first run downloads a model, which needs a connection once.
  • Filter lists go stale without the three-day refresh.

Other ways people ask this

  • browser works with the wifi off

Related