LLMs Usage FAQ: Difference between revisions

Jump to navigation Jump to search
Line 267: Line 267:
Please provide a CSV file using a Traditional Chinese filename.
Please provide a CSV file using a Traditional Chinese filename.
</pre>
</pre>
== Is There AI Software That Works Without Internet Connection ==
📝 Problem: Is There AI Software That Works Without Internet Connection?
💬 Answer: Offline AI Software Options
I've compiled a [[Run_LLMs_locally | list of software that can run AI models offline]]. I recommend trying Ollama or LM Studio.
Consideration 1: Adjust Performance Expectations
If you're accustomed to cloud-based AI models, you may find it challenging to adapt to local model performance.
You'll need to lower your expectations for local models.
Consideration 2: Model Selection and Practical Applications
Currently, the most commonly used local model is gpt-oss:120b. According to Jerry from Asia Pacific Intelligence, it lacks knowledge about Taiwan-specific topics. In my testing, it performs adequately for basic tagging tasks.
Practical Work Applications:
Assign relatively simple tasks, such as:
(1) Use cloud models to search and compile data, then have local models verify it again
(2) For privacy-sensitive data that must be processed solely by local models


== Related articles ==
== Related articles ==

Navigation menu