15,024
edits
Run LLMs locally: Difference between revisions
Jump to navigation
Jump to search
m
→List of LLMs software
mNo edit summary |
|||
| (4 intermediate revisions by the same user not shown) | |||
| Line 5: | Line 5: | ||
* Docker support: Available<ref>[https://ollama.com/blog/ollama-is-now-available-as-an-official-docker-image Ollama is now available as an official Docker image · Ollama Blog]</ref> {{Gd}} | * Docker support: Available<ref>[https://ollama.com/blog/ollama-is-now-available-as-an-official-docker-image Ollama is now available as an official Docker image · Ollama Blog]</ref> {{Gd}} | ||
* Supported OS: {{Win}}, {{Mac}} & {{Linux}} | * Supported OS: {{Win}}, {{Mac}} & {{Linux}} | ||
* User Interface: CLI (Command-line interface) | * User Interface: CLI (Command-line interface) & GUI (Graphical User Interface) | ||
* Support API endpoint: Available<ref>[https://github.com/ollama/ollama?tab=readme-ov-file#rest-api ollama/ollama: Get up and running with Llama 3, Mistral, Gemma, and other large language models.]</ref> | * Support API endpoint: Available<ref>[https://github.com/ollama/ollama?tab=readme-ov-file#rest-api ollama/ollama: Get up and running with Llama 3, Mistral, Gemma, and other large language models.]</ref> | ||
* Supported embedding models: | * Supported embedding models: | ||
* License: | * License: Open-source license, MIT<ref>[https://github.com/ollama/ollama/blob/main/LICENSE ollama/LICENSE at main · ollama/ollama]</ref> {{Gd}} | ||
[https://lmstudio.ai/ LM Studio - Discover, download, and run local LLMs] | [https://lmstudio.ai/ LM Studio - Discover, download, and run local LLMs] | ||
| Line 87: | Line 87: | ||
* [https://github.com/Troyanovsky/Local-LLM-Comparison-Colab-UI Troyanovsky/Local-LLM-Comparison-Colab-UI: Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.] | * [https://github.com/Troyanovsky/Local-LLM-Comparison-Colab-UI Troyanovsky/Local-LLM-Comparison-Colab-UI: Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.] | ||
* [https://abishekmuthian.com/how-i-run-llms-locally/ How I run LLMs locally - Abishek Muthian] | * [https://abishekmuthian.com/how-i-run-llms-locally/ How I run LLMs locally - Abishek Muthian] | ||
* [https://iamhlb.notion.site/HOWTO-Setup-Local-LLM-16757ba4def5805c9baad0c78d54d62f HOWTO: Setup Local LLM] | |||
== References == | == References == | ||