14,962
edits
LLMs Usage FAQ: Difference between revisions
Jump to navigation
Jump to search
m
→Is There AI Software That Works Without Internet Connection
| Line 271: | Line 271: | ||
== Is There AI Software That Works Without Internet Connection == | == Is There AI Software That Works Without Internet Connection == | ||
📝 | 📝 Question: Is There AI Software That Works Without Internet Connection? | ||
💬 Answer: Offline AI Software Options | 💬 Answer: Offline AI Software Options | ||
Actually, there are quite a few software options that can run AI models offline ([[Run_LLMs_locally | list of software that can run AI models offline]]). I recommend trying Ollama or LM Studio. | |||
Considerations for Using Local Models | |||
(1) Adjust Expectations for Local Models | |||
If you're accustomed to using cloud-based AI models, you'll find it more difficult to adapt to local model performance. You need to lower your expectations for local models. | |||
Practical Work Applications: | (2) Model Selection and Practical Applications | ||
(1) Use cloud models to search and compile data, then have local models | Currently, the local model I use most often is gpt-oss:120b. Jerry from Asia Pacific Intelligence shared at a Generative AI meetup that it lacks knowledge about Taiwan-specific topics. In my actual testing, it performs quite well for basic tagging tasks. | ||
(2) For | |||
Practical Work Applications: I assign relatively simple tasks, such as: | |||
(1) Use cloud models to search and compile data, then have local models perform secondary verification | |||
(2) For data that requires special privacy protection, it must be processed by local models | |||
== Related articles == | == Related articles == | ||