An assistant that works with the wifi off
Short answer
Once a model is downloaded, the assistant works with no connection at all — on a plane, on a train, or on an air-gapped machine.
The problem it exists for
Cloud assistants are exactly as available as your connection, which is a problem in the places where uninterrupted reading time actually exists.
How it works
- The model file and the inference engine are both local, so answering needs no network.
- Documents already on the machine are read the same offline as online.
- On an air-gapped machine, download the GGUF elsewhere and copy the file across.
What it does not do
- Browsing needs a network; only the assistant works without one.
- The first run downloads a model, which needs a connection once.
- Filter lists go stale without the three-day refresh.
Other ways people ask this
- browser works with the wifi off