A lightweight wrapper around llama.cpp's llama-server that simplifies installation, configuration, and lifecycle management of a local LLM inference server. It supports OpenAI-compatible REST API ...
GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results