Package lemonade-server
Local LLM serving with GPU and NPU acceleration
https://github.com/lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized
LLMs right from their own GPUs and NPUs. It supports GGUF, FLM, and
ONNX models.
Version: 10.9.0
General Commands | |
| lemonade | command line interface |
| lemond | Request router for Lemonade LLM serving system |