14,953
edits
Run LLMs locally: Difference between revisions
Jump to navigation
Jump to search
+ MLC LLM
No edit summary |
(+ MLC LLM) |
||
| Line 58: | Line 58: | ||
* License: | * License: | ||
[https://llm.mlc.ai/ MLC LLM] | |||
* Docker support: Not available<ref>[https://github.com/mlc-ai/mlc-llm/issues/33 Docker support · Issue #33 · mlc-ai/mlc-llm]</ref> | |||
* Supported OS: {{Win}}, {{Mac}} & {{Linux}} <ref>[https://llm.mlc.ai/docs/install/mlc_llm Install MLC LLM Python Package — mlc-llm 0.1.0 documentation]</ref> | |||
* User Interface: CLI | |||
* Support API endpoint: Available<ref>[https://llm.mlc.ai/docs/deploy/rest.html REST API — mlc-llm 0.1.0 documentation]</ref> | |||
* License: OSS, Apache License Version 2.0<ref>[https://github.com/mlc-ai/mlc-llm/blob/main/LICENSE mlc-llm/LICENSE at main · mlc-ai/mlc-llm]</ref> | |||
(left blank intentionally) | (left blank intentionally) | ||