Editing LLMs Usage FAQ (section)

== Is There AI Software That Works Without Internet Connection ==

📝 Question: Is There AI Software That Works Without Internet Connection?

💬 Answer: Offline AI Software Options

Actually, there are quite a few software options that can run AI models offline ([[Run_LLMs_locally | list of software that can run AI models offline]]). I recommend trying Ollama or LM Studio.

Considerations for Using Local Models

(1) Adjust Expectations for Local Models

If you're accustomed to using cloud-based AI models, you'll find it more difficult to adapt to local model performance. You need to lower your expectations for local models.

(2) Model Selection and Practical Applications

Currently, the local model I use most often is gpt-oss:120b. Jerry from Asia Pacific Intelligence shared at a Generative AI meetup that it lacks knowledge about Taiwan-specific topics. In my actual testing, it performs quite well for basic tagging tasks.

Practical Work Applications: I assign relatively simple tasks, such as:
(1) Use cloud models to search and compile data, then have local models perform secondary verification
(2) For data that requires special privacy protection, it must be processed by local models